-- Logs begin at Tue 2022-08-09 10:34:05 UTC, end at Tue 2022-08-09 11:35:50 UTC. -- Aug 09 11:09:23.646065 dv-cinder-852514-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 09 11:09:23.655767 dv-cinder-852514-2-iscsi devstack@n-api.service[103157]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 09 11:09:23.658357 dv-cinder-852514-2-iscsi devstack@n-api.service[103157]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 9 11:09:23 2022] *** Aug 09 11:09:23.658357 dv-cinder-852514-2-iscsi devstack@n-api.service[103157]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 09 11:09:23.658357 dv-cinder-852514-2-iscsi devstack@n-api.service[103157]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 09 11:09:23.658357 dv-cinder-852514-2-iscsi devstack@n-api.service[103157]: nodename: dv-cinder-852514-2-iscsi Aug 09 11:09:23.658357 dv-cinder-852514-2-iscsi devstack@n-api.service[103157]: machine: x86_64 Aug 09 11:09:23.658357 dv-cinder-852514-2-iscsi devstack@n-api.service[103157]: clock source: unix Aug 09 11:09:23.658357 dv-cinder-852514-2-iscsi devstack@n-api.service[103157]: pcre jit disabled Aug 09 11:09:23.658357 dv-cinder-852514-2-iscsi devstack@n-api.service[103157]: detected number of CPU cores: 4 Aug 09 11:09:23.658357 dv-cinder-852514-2-iscsi devstack@n-api.service[103157]: current working directory: / Aug 09 11:09:23.658357 dv-cinder-852514-2-iscsi devstack@n-api.service[103157]: detected binary path: /usr/bin/uwsgi-core Aug 09 11:09:23.659050 dv-cinder-852514-2-iscsi devstack@n-api.service[103157]: your processes number limit is 47680 Aug 09 11:09:23.659050 dv-cinder-852514-2-iscsi devstack@n-api.service[103157]: your memory page size is 4096 bytes Aug 09 11:09:23.659050 dv-cinder-852514-2-iscsi devstack@n-api.service[103157]: detected max file descriptor number: 2048 Aug 09 11:09:23.659050 dv-cinder-852514-2-iscsi devstack@n-api.service[103157]: lock engine: pthread robust mutexes Aug 09 11:09:23.659050 dv-cinder-852514-2-iscsi devstack@n-api.service[103157]: thunder lock: enabled Aug 09 11:09:23.659050 dv-cinder-852514-2-iscsi devstack@n-api.service[103157]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 09 11:09:23.659050 dv-cinder-852514-2-iscsi devstack@n-api.service[103157]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 09 11:09:23.698477 dv-cinder-852514-2-iscsi devstack@n-api.service[103157]: Python main interpreter initialized at 0x55578b3649c0 Aug 09 11:09:23.698477 dv-cinder-852514-2-iscsi devstack@n-api.service[103157]: python threads support enabled Aug 09 11:09:23.698477 dv-cinder-852514-2-iscsi devstack@n-api.service[103157]: your server socket listen backlog is limited to 100 connections Aug 09 11:09:23.698477 dv-cinder-852514-2-iscsi devstack@n-api.service[103157]: your mercy for graceful operations on workers is 90 seconds Aug 09 11:09:23.698853 dv-cinder-852514-2-iscsi devstack@n-api.service[103157]: mapped 403077 bytes (393 KB) for 2 cores Aug 09 11:09:23.698853 dv-cinder-852514-2-iscsi devstack@n-api.service[103157]: *** Operational MODE: preforking *** Aug 09 11:09:23.699274 dv-cinder-852514-2-iscsi devstack@n-api.service[103157]: *** uWSGI is running in multiple interpreter mode *** Aug 09 11:09:23.699274 dv-cinder-852514-2-iscsi devstack@n-api.service[103157]: spawned uWSGI master process (pid: 103157) Aug 09 11:09:23.699483 dv-cinder-852514-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 09 11:09:23.700030 dv-cinder-852514-2-iscsi devstack@n-api.service[103157]: spawned uWSGI worker 1 (pid: 103158, cores: 1) Aug 09 11:09:23.700443 dv-cinder-852514-2-iscsi devstack@n-api.service[103157]: spawned uWSGI worker 2 (pid: 103159, cores: 1) Aug 09 11:09:23.700639 dv-cinder-852514-2-iscsi devstack@n-api.service[103157]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 09 11:09:24.370349 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 09 11:09:24.376878 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 09 11:09:25.458150 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 11:09:25.458150 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: from cryptography.utils import int_from_bytes Aug 09 11:09:25.458805 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 11:09:25.458805 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: from cryptography.utils import int_from_bytes Aug 09 11:09:25.465743 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 11:09:25.465743 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: from cryptography.utils import int_from_bytes Aug 09 11:09:25.466236 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 11:09:25.466236 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: from cryptography.utils import int_from_bytes Aug 09 11:09:27.959366 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 11:09:27.960047 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 11:09:27.960177 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 11:09:27.960592 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 11:09:27.960687 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 11:09:27.960757 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 11:09:27.960757 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 11:09:27.960876 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 11:09:27.961123 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.961232 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 11:09:27.961366 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 11:09:27.961454 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.961783 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.961932 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.962106 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.962235 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.962402 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.962491 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.962740 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.962868 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.963058 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.963197 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.963371 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.963498 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.963691 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.963819 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.963912 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.964005 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.964319 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.964516 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.964650 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.964747 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852514-2-iscsi {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.964879 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.964989 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.965174 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.965322 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852514-2-iscsi {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.965505 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.965644 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.965822 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.965964 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.966096 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.966208 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.966438 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.966573 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.966739 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.966890 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.967054 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.967225 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.967337 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.968996 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.969278 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.969483 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.969672 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.969860 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.970054 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.970242 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.970387 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.970598 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.970794 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.970794 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.971112 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.971295 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.971501 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.971702 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.971878 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.972075 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.972255 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.972440 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.972612 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.972842 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.973030 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852514-2-iscsi {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.973228 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852514-2-iscsi {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.973376 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.973549 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.973726 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.973875 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.974004 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.974156 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.974279 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.974421 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.974589 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.974710 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.974828 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.974962 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.975088 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.975246 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.975398 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.975541 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.975707 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.975838 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.975956 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.976082 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.976220 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.976355 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.976487 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.976639 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.976776 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.976914 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.977033 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.977169 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.977289 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.977413 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.977532 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.977686 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.977818 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.977941 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.978059 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.978181 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.978314 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.978451 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.978574 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.978701 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.978825 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.978944 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.979061 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.979342 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.979474 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.979580 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.979705 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.979843 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.979986 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.979986 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.980240 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.980240 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.980507 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.980646 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.980779 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.980914 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.981034 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.981164 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.981290 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.981419 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.981557 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.981694 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.981814 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.981939 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.982079 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.982223 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.982346 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.982346 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.982596 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.982724 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.982856 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.982856 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.983086 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.983203 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.983327 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.983450 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.983582 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.983708 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.983948 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.984072 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.984191 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.984328 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.984470 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.984591 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.984709 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.984845 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.984972 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.985098 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.985224 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.985347 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.985460 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.985581 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.985698 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.985815 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.985946 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.986082 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.986205 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.986334 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.986458 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.986591 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.986726 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.986844 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.986970 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.987088 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.987215 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.987398 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.987537 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.987724 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.987852 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.988030 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.988158 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.988313 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.988447 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.988583 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.988710 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.988885 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.989012 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.989207 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.989344 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.989479 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.989608 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.989805 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.989941 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.990094 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.990220 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.990398 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.990523 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.990703 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.990845 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.990998 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.991132 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.991305 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.991440 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.991604 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.991739 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.991907 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.992045 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.992193 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.992396 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.992521 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.992659 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.992791 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.992926 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.993133 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.993259 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.993458 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.993595 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.993745 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.993869 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.994053 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.994186 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.994321 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.994439 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.994645 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.994780 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.994963 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.995094 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.995222 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.995354 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.995540 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.995666 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.995864 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.995994 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.996162 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.996317 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.996497 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.996637 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.996811 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.996944 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.997103 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.997224 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.997414 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.997549 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.997720 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.997851 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.997984 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.998108 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.998303 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.998428 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.998618 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.998745 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.998930 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.999095 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.999227 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.999347 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.999618 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.999744 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:27.999928 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:28.000053 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:28.000234 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:28.000396 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:28.000570 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:28.000717 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:28.000869 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:28.000993 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:28.001190 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:28.001318 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:28.001499 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:28.001626 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:28.001802 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:28.001936 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:28.002120 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:28.002253 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:28.002408 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:28.002548 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:28.002728 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:28.002861 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:28.003037 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:28.003167 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:28.003341 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:28.003474 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:28.003661 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:09:28.003791 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.003997 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.004120 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.004342 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.004473 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.004666 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.004790 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.004997 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.005139 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.005330 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.005455 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.005649 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.005773 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.005959 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.006090 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.006271 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.006412 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.006585 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.006709 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.006891 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.007031 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.007211 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.007341 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.007506 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.007631 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.007832 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.007971 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.008147 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.008302 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.008482 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.008614 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.008806 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.008929 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.009122 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.009263 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.009440 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.009564 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.009731 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.009866 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.010053 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.010182 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.010373 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.010504 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.010692 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.010826 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.011000 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.011125 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.011329 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.011456 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.011666 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.011813 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.011987 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.012125 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.012325 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.012453 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.012661 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.012794 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.012972 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.013099 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.013300 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.013509 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.013646 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.013771 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.013913 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.014034 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.014246 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.014369 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.014559 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.014685 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.014875 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.015004 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.015217 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.015338 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.015527 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.015721 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.015857 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.016044 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.016167 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.016382 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.016522 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.016699 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.016829 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.017020 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.017148 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.017368 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.017501 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.017678 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.017807 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.017993 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.018431 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.018624 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.018745 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.018939 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.019065 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.019250 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.019370 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.019555 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.019678 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.019857 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.019994 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.020190 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.020350 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.020481 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.020603 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.020788 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.020920 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.021097 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.021224 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.021404 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.021528 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.021706 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.021827 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.022041 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.022177 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.022349 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.022478 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.022656 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.022779 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.022970 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.023100 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.023280 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.023407 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.023581 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.023708 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.023889 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.024024 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.024193 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.024364 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.024522 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.024643 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.024832 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.024965 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.025143 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.025263 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.025451 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.025574 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.025760 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.025881 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.026059 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.026181 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.026367 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.026501 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.026673 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.026794 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.026984 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.027105 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.027296 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.027416 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.027618 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.027738 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.027898 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.028032 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.028206 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.028425 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.028548 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.028669 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.028835 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.028958 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.029166 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.029296 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.029478 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.029604 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.029784 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.029904 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.030104 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.030248 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.030432 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.030561 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.030817 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.030974 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.031101 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.031232 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.031413 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.031535 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.031720 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.031855 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.032025 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.032163 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.032342 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.032472 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.032660 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.032789 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.032963 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.033086 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.033274 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.033400 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.033577 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.033698 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.033884 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.034007 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.034188 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.034308 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.034503 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.034626 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.034807 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.034939 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.035106 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.035230 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.035410 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.035532 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.035711 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.035835 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.036017 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.036138 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.036347 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.036490 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.036704 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.036847 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.037011 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.037134 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.037338 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.037483 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.037653 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.037774 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.037964 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.038085 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.038278 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.038409 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.038620 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.038748 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.038890 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.039012 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.039205 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.039342 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.039515 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.039640 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.039825 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.039953 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.040131 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.040251 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.040471 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.040603 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.040785 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.040912 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.041104 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.041227 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.041415 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.041536 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.041728 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.041848 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.042030 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.042161 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.042340 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.042468 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.042642 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.042763 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.042965 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.043087 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.043290 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.043417 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.043608 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.043731 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.043916 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.044039 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.044226 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.044372 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.044555 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.044698 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.044863 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.044984 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.045169 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.045300 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.045477 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.045608 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.045785 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.045910 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.046092 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.046223 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.046457 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.046591 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.046823 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.047053 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.047185 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.047318 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.047438 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.047570 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.047695 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.047824 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.047963 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.048092 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.048320 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.048447 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.048618 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.048745 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.048957 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.049082 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.049261 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.049388 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.049569 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.049699 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.049893 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.050016 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.050206 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.050328 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.050512 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.050636 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.050819 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.050949 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.051120 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.051251 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.051424 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.051547 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.051729 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.051861 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.052043 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.052159 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.052368 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.052505 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.052679 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.052809 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.052983 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.053106 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.053298 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.053423 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.053608 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.053739 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.053908 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.054035 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.054209 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.054330 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.054513 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.054645 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.054821 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.054949 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.055138 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.055260 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.055460 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.055602 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.055771 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.055892 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.056081 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.056196 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.056429 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.056551 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.056714 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.056836 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.057023 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.057144 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.057325 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.057449 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.057626 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.057748 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.057933 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.058055 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.058242 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.058365 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.058555 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.058678 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.058876 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.058999 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.059167 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.059290 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.059485 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.059607 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.059799 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.059931 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.060104 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.060234 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.060444 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.060571 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.060749 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.060901 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.061063 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.061183 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.061376 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.061499 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.061682 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.061827 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.062053 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.062183 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.062361 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.062488 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.062668 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.062799 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.062975 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.063091 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.063296 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.063418 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.063602 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.063732 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.063909 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.064032 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.064217 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.064360 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.064554 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.064679 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.064874 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.065004 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.065182 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.065303 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.065494 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.065798 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.065929 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.066134 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.066417 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.066549 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.066751 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.066874 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.067079 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.067209 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.067385 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.067514 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.067707 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.067828 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.068039 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.068168 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.068392 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.068533 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.068701 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.068825 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.069012 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.069134 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.069317 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.069448 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.069618 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.069749 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.069928 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.070051 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.070233 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.070363 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.070535 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.070664 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.070842 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.070970 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.071157 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.071288 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.071462 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.071586 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.071765 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.071882 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.072065 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.072196 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.072389 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.072533 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.072691 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.072823 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.072999 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.073121 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.073309 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.073442 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.073612 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.073732 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.073921 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.074042 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.074223 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.074346 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.074520 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.074641 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.074819 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.074943 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.075117 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.075247 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.075423 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.075544 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.075729 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.075843 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.076058 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.076189 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.076390 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.076512 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.076730 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.076864 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.077032 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.077161 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.077343 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.077465 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.077710 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.077867 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.078009 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.078134 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.078449 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.078571 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.078763 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.078902 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.079059 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.079180 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.079363 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.079492 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.079663 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.079793 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.079970 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.080091 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.080320 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.080455 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.080664 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.080785 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.080904 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.081024 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.081185 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.081309 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.081493 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.081615 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.081792 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.081913 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.082100 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.082221 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.082414 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.082543 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.082702 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.082825 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.083007 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.083129 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.083308 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.083436 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.083609 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.083737 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.083906 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.084042 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.084218 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.084358 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.084540 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.084661 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.084851 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.084991 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.085154 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.085282 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.085450 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.085573 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.085749 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.085880 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.086047 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.086174 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.086348 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.086469 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.086655 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.086785 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.086966 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.087086 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.087268 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.087389 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.087568 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.087693 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.087873 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.088001 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.088178 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.088362 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.088496 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.088624 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.088789 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.088919 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.089105 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.089225 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.089420 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.089566 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.089713 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.089835 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.090010 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.090130 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.090315 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.090438 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.090613 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.090756 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.090914 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.091050 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.091213 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.091343 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.091514 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.091635 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.091809 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.091945 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.092109 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.092239 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.092431 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.092557 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.092731 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.092862 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.093040 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.093250 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.093385 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.093512 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.093678 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.093809 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.094006 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.094129 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.094317 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.094439 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.094616 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.094738 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.094931 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.095061 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.095236 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.095359 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.095586 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.095709 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.095883 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.096017 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.096206 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.096373 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.096555 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.096678 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.096870 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.096998 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.097177 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.097299 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.097486 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.097607 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.097784 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.097913 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.098098 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.098222 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.098403 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.098525 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.098718 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.098838 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.099025 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.099187 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.099328 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.099451 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.099631 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.099751 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.099935 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.100080 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.100244 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.100387 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.100582 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.100706 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.100891 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.101020 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.101218 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.101347 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.101518 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.101641 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.101825 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.101956 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.102130 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.102253 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.102434 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.102558 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.102743 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.102865 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.103050 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.103178 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.103356 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.103471 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.104213 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.104392 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.104503 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.104620 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.104726 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.104834 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.104944 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.105054 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.105161 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.105262 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.105365 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.105466 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.105584 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.105688 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.105803 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.105906 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.106053 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.106173 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.107918 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.108075 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.108203 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.108339 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.108468 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.108611 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.108736 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.108952 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.109107 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.109236 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.109363 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.109489 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.109609 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.109738 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.109862 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.109981 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.110102 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.110282 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.110404 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.110526 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.110645 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.110775 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.110903 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.111024 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.111145 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.111263 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.111380 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.111499 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.111626 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.111746 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.111873 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.111873 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.112102 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.112102 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.112356 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.112478 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.112599 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.112728 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.112853 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.112975 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.113106 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.113235 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.113361 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.113487 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.113597 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.113713 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.113839 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.113960 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.114078 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.114200 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.114325 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.114454 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.114581 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.114743 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.114878 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.115045 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.115168 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.115364 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.115487 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.115680 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.115812 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.116073 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.116198 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.116400 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.116539 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.116709 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.116822 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.117098 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.117229 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.117410 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.117532 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.117716 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.117836 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.118041 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.118173 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.118359 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.118481 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.118662 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.118784 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.118970 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.119100 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.119284 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.119498 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.119623 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.119741 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.119909 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.120032 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.120224 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.120390 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.120568 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.120689 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.120868 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.120988 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.121173 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.121309 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.121497 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.121619 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.121806 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.121928 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.122119 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.122241 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.122439 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.122561 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.122842 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.122962 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.123158 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.123281 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.123466 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.123587 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.123787 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.123917 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.124086 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.124213 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.124480 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.124613 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.124795 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.124919 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.125104 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.125234 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.125406 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.125535 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.125711 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.125842 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.126011 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.126133 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.126320 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.126450 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.126627 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.126758 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.126933 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.127054 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.127232 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.127353 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.127533 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.127665 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.127834 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.127955 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.128135 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.128256 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.128472 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.128607 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.128780 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.128901 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.129092 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.129212 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.129408 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.129529 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.129713 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.129836 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.130018 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.130146 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.130322 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.130444 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.130628 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.130752 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.130930 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.131058 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.131229 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.131351 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.131530 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.131653 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.131861 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.131982 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.132166 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.132306 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.132511 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.132650 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.132836 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.132966 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.133148 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.133273 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.133453 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.133584 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.133784 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.133911 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.134093 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.134216 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.134407 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.134529 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.134725 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.134862 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.135025 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.135148 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.135333 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.135455 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.135633 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.135765 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.135935 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.136057 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.136235 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.136395 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.136560 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.136688 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.136864 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.136986 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.137166 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.137290 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.137467 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.137589 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.137761 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.137883 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.138068 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.138197 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.138366 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.138488 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.138683 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.138826 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.138986 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.139102 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.139289 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.139402 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.139596 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.139721 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.139900 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.140059 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.140236 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.140511 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.140600 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.140855 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.140943 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.141193 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.141283 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.141507 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.141593 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.141838 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.141930 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.142159 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.142249 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.142473 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.142560 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.142788 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.142872 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.143441 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.143557 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.143759 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.143853 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.144077 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.144189 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.144416 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.144520 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.144730 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.144820 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.145051 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.145155 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.145370 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.145461 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.145678 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.145766 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.146224 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.146326 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.146556 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.146663 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.146884 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.146987 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.147197 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.147305 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.147515 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.147603 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.147818 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.147911 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.148128 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.148215 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.148465 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.148570 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.148782 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.148870 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.149100 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.149198 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.149414 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.149500 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.149734 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.149819 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.150067 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.150161 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.150389 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.150481 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.150723 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.150830 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.151053 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.151147 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.151379 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.151478 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.151690 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.151785 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.152000 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.152091 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.152375 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.152470 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.152690 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.152778 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.152991 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.153077 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.153300 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.153390 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.153618 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.153726 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.153928 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.154014 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.154245 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.154354 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.154564 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.154655 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.154872 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.154965 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.155184 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.155277 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.155488 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.155575 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.155856 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.156005 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.156171 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.156388 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.156585 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.156915 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.157248 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.157564 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.157876 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.158198 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.158511 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.158884 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.159036 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.159229 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.159368 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.159579 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.159712 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.159928 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.160064 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.160243 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.160414 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.160600 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.160723 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.160921 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.161059 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.161243 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.161446 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.161586 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.161774 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.161897 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.162113 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.162259 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.162417 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.162539 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.162719 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.162844 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.163091 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.163233 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.163365 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.163494 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.163646 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.163770 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.163965 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.164097 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.164287 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.164417 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.164625 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.164823 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.164948 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.165177 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.165310 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.165489 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.165619 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.165819 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.165950 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.166132 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.166263 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.166455 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.166579 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.166760 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.166900 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.167088 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.167298 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.167410 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.167657 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.167759 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.167981 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.168087 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.168302 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.168434 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.168608 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.168732 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.168910 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.169035 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.169220 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.169344 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.169531 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.169663 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.169833 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.169957 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.170142 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.170270 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.170440 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.170578 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.170756 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.170876 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.171062 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.171193 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.171422 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.171574 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.171723 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.171899 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.172030 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.172348 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.172473 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.172653 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.172776 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.172953 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.173076 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.173254 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.173390 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.173572 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.173697 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.173878 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.174008 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.174195 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.174331 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.174489 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.174611 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.174807 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.174937 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.175102 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.175232 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.175403 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.175539 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.175711 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.175834 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.176020 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.176151 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.176341 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.176472 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.176661 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.176794 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.176974 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.177120 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.177282 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.177487 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.177613 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.177748 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.177884 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.178005 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.178181 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.178305 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.178485 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.178615 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.178811 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.178937 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.179124 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.179336 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.179481 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.179667 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.179874 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.179999 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.180118 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.180321 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.180451 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.180660 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.180793 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.180964 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.181098 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.181267 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.181391 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.181570 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.181701 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.181898 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.182206 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.182327 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.182512 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.182643 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.182819 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.182942 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.183146 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.183268 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.183440 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.183573 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.183749 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.183872 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.184065 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.184190 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.184397 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.184516 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.184706 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.184829 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.185013 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.185135 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.185320 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.185452 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.185629 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.185752 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.185940 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.186068 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.186245 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.186369 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.186555 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.186686 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.186886 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.187047 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.187269 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.187393 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.187671 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.187798 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.187919 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.188047 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.188168 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.188315 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.188505 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.188633 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.188817 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.188952 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.189130 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.189252 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.189436 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.189567 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.189754 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.189891 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.190097 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.190225 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.190409 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.190539 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.190714 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.190845 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.191042 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.191163 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.191365 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.191488 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.191681 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.191813 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.191995 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.192118 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.192333 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.192474 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.192664 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.192786 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.192996 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.193125 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.193307 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.193440 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.193612 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.193734 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.193939 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.194060 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.194266 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.194397 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.194603 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.194733 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.194930 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.195053 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.195260 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.195391 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.195563 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.195687 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.195873 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.196003 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.196176 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.196315 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.196512 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.196652 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.196831 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.196958 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.197145 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.197277 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.197449 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.197572 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.197755 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.197898 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.198061 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.198184 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.198366 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.198505 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.198670 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.198802 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.198972 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.199097 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.199257 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.199386 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.199572 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.199707 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.199868 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.199997 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.200175 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.200341 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.200501 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.200637 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.200804 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.200935 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.201106 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.201238 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.201407 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.201530 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.201725 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.201850 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.202027 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.202150 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.202329 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.202454 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.202658 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.202804 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.202949 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.203070 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.203266 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.203389 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.203575 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.203723 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.203882 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.204064 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.204196 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.204404 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.204540 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.204723 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.204854 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.205036 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.205168 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.205357 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.205486 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.205664 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.205793 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.205973 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.206096 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.206302 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.206423 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.206636 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.206767 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.206942 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.207065 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.207266 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.207387 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.207577 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.207697 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.207889 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.208012 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.208206 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.208369 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.208542 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.208746 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.208876 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.208996 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.209147 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.209274 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.209470 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.209600 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.209801 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.209929 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.210107 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.210235 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.210423 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.210550 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.210740 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.210876 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.211052 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.211183 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.211364 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.211491 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.211673 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.211806 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.212000 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.212121 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.212331 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.212450 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.212648 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.212782 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.212954 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.213079 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.213264 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.213396 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.213579 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.213704 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.213892 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.214022 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.214200 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.214328 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.214518 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.214642 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.214834 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.214963 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.215143 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.215266 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.215453 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.215576 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.215767 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.215903 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.216077 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.216200 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.216418 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.216551 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.216740 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.216864 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.217055 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.217181 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.217390 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.217528 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.217707 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.217832 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.218035 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.218202 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.218565 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.218689 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.218883 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.219007 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.219193 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.219323 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.219443 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 11:09:28.219633 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.219995 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.220345 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.220702 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.221037 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.221356 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.221675 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.221983 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:09:28.222226 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 11:09:28.388258 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: INFO dbcounter [None req-304a1595-6b01-4417-9e82-38940151aeb2 None None] Registered counter for database nova_api Aug 09 11:09:28.394979 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: INFO dbcounter [None req-5b2a0c3e-3025-4356-be05-882efacbd40a None None] Registered counter for database nova_api Aug 09 11:09:28.411315 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG oslo_db.sqlalchemy.engines [None req-304a1595-6b01-4417-9e82-38940151aeb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103159) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 11:09:28.415484 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG oslo_db.sqlalchemy.engines [None req-5b2a0c3e-3025-4356-be05-882efacbd40a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103158) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 11:09:28.418919 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG dbcounter [-] [103159] Writer thread running {{(pid=103159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 11:09:28.422729 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG dbcounter [-] [103158] Writer thread running {{(pid=103158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 11:09:28.475957 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.context [None req-304a1595-6b01-4417-9e82-38940151aeb2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ad0e4d4c-ebcc-4363-b137-c73e7b855b1b(cell1) {{(pid=103159) load_cells /opt/stack/nova/nova/context.py:464}} Aug 09 11:09:28.480082 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG oslo_concurrency.lockutils [None req-304a1595-6b01-4417-9e82-38940151aeb2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103159) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:09:28.480258 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.context [None req-5b2a0c3e-3025-4356-be05-882efacbd40a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ad0e4d4c-ebcc-4363-b137-c73e7b855b1b(cell1) {{(pid=103158) load_cells /opt/stack/nova/nova/context.py:464}} Aug 09 11:09:28.480598 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG oslo_concurrency.lockutils [None req-304a1595-6b01-4417-9e82-38940151aeb2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103159) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:09:28.482207 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG oslo_concurrency.lockutils [None req-304a1595-6b01-4417-9e82-38940151aeb2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103159) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:09:28.482944 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG oslo_concurrency.lockutils [None req-304a1595-6b01-4417-9e82-38940151aeb2 None None] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103159) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:09:28.483388 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG oslo_concurrency.lockutils [None req-304a1595-6b01-4417-9e82-38940151aeb2 None None] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103159) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:09:28.484554 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG oslo_concurrency.lockutils [None req-5b2a0c3e-3025-4356-be05-882efacbd40a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:09:28.485044 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG oslo_concurrency.lockutils [None req-5b2a0c3e-3025-4356-be05-882efacbd40a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:09:28.485863 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG oslo_concurrency.lockutils [None req-304a1595-6b01-4417-9e82-38940151aeb2 None None] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103159) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:09:28.486614 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG oslo_concurrency.lockutils [None req-5b2a0c3e-3025-4356-be05-882efacbd40a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:09:28.487332 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG oslo_concurrency.lockutils [None req-5b2a0c3e-3025-4356-be05-882efacbd40a None None] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:09:28.487778 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG oslo_concurrency.lockutils [None req-5b2a0c3e-3025-4356-be05-882efacbd40a None None] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:09:28.487876 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: INFO dbcounter [None req-304a1595-6b01-4417-9e82-38940151aeb2 None None] Registered counter for database nova_cell0 Aug 09 11:09:28.491418 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG oslo_concurrency.lockutils [None req-5b2a0c3e-3025-4356-be05-882efacbd40a None None] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:09:28.492396 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: INFO dbcounter [None req-5b2a0c3e-3025-4356-be05-882efacbd40a None None] Registered counter for database nova_cell0 Aug 09 11:09:28.493537 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: INFO dbcounter [None req-304a1595-6b01-4417-9e82-38940151aeb2 None None] Registered counter for database nova_cell1 Aug 09 11:09:28.498513 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: INFO dbcounter [None req-5b2a0c3e-3025-4356-be05-882efacbd40a None None] Registered counter for database nova_cell1 Aug 09 11:09:28.502519 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG oslo_db.sqlalchemy.engines [None req-304a1595-6b01-4417-9e82-38940151aeb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103159) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 11:09:28.504421 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG oslo_db.sqlalchemy.engines [None req-304a1595-6b01-4417-9e82-38940151aeb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103159) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 11:09:28.507684 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG oslo_db.sqlalchemy.engines [None req-5b2a0c3e-3025-4356-be05-882efacbd40a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103158) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 11:09:28.509982 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG oslo_db.sqlalchemy.engines [None req-5b2a0c3e-3025-4356-be05-882efacbd40a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103158) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 11:09:28.510253 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG dbcounter [-] [103159] Writer thread running {{(pid=103159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 11:09:28.513070 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG dbcounter [-] [103159] Writer thread running {{(pid=103159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 11:09:28.516066 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG dbcounter [-] [103158] Writer thread running {{(pid=103158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 11:09:28.517597 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG dbcounter [-] [103158] Writer thread running {{(pid=103158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 11:09:28.657264 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: INFO dbcounter [None req-304a1595-6b01-4417-9e82-38940151aeb2 None None] Registered counter for database nova_cell0 Aug 09 11:09:28.663734 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: INFO dbcounter [None req-5b2a0c3e-3025-4356-be05-882efacbd40a None None] Registered counter for database nova_cell0 Aug 09 11:09:28.667446 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG oslo_db.sqlalchemy.engines [None req-304a1595-6b01-4417-9e82-38940151aeb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103159) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 11:09:28.672221 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG oslo_db.sqlalchemy.engines [None req-5b2a0c3e-3025-4356-be05-882efacbd40a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103158) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 11:09:28.673970 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG dbcounter [-] [103159] Writer thread running {{(pid=103159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 11:09:28.679158 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG dbcounter [-] [103158] Writer thread running {{(pid=103158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 11:09:29.021163 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: WARNING keystonemiddleware.auth_token [None req-304a1595-6b01-4417-9e82-38940151aeb2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 11:09:29.028743 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: WARNING keystonemiddleware.auth_token [None req-304a1595-6b01-4417-9e82-38940151aeb2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 11:09:29.099061 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: WARNING keystonemiddleware.auth_token [None req-5b2a0c3e-3025-4356-be05-882efacbd40a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 11:09:29.108220 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: WARNING keystonemiddleware.auth_token [None req-5b2a0c3e-3025-4356-be05-882efacbd40a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 11:09:29.377739 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: WARNING keystonemiddleware.auth_token [None req-304a1595-6b01-4417-9e82-38940151aeb2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 11:09:29.384131 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: WARNING keystonemiddleware.auth_token [None req-304a1595-6b01-4417-9e82-38940151aeb2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 11:09:29.389848 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55578b3649c0 pid: 103159 (default app) Aug 09 11:09:29.392301 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-304a1595-6b01-4417-9e82-38940151aeb2 None None] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:09:29.393931 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-304a1595-6b01-4417-9e82-38940151aeb2 None None] 10.222.0.27 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002362 Aug 09 11:09:29.394337 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 788 bytes} [Tue Aug 9 11:09:29 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:09:29.543415 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: WARNING keystonemiddleware.auth_token [None req-5b2a0c3e-3025-4356-be05-882efacbd40a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 11:09:29.551758 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: WARNING keystonemiddleware.auth_token [None req-5b2a0c3e-3025-4356-be05-882efacbd40a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 11:09:29.558867 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55578b3649c0 pid: 103158 (default app) Aug 09 11:10:46.634819 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-304a1595-6b01-4417-9e82-38940151aeb2 None None] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:10:46.635817 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-304a1595-6b01-4417-9e82-38940151aeb2 None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 09 11:10:46.636184 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 2/2] 10.222.0.27 () {54 vars in 931 bytes} [Tue Aug 9 11:10:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:10:46.648573 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG dbcounter [-] [103158] Writing DB stats nova_api:SELECT=3 {{(pid=103158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:10:46.649498 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG dbcounter [-] [103158] Writing DB stats nova_cell0:SELECT=3 {{(pid=103158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:10:46.650694 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG dbcounter [-] [103158] Writing DB stats nova_cell1:SELECT=3 {{(pid=103158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:10:46.651685 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG dbcounter [-] [103158] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:10:47.503888 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-fd7ae19a-9b85-4682-8400-e25eddd71694 admin admin] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:10:47.543095 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-fd7ae19a-9b85-4682-8400-e25eddd71694 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.899751 Aug 09 11:10:47.556302 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 1/3] 10.222.0.27 () {60 vars in 1292 bytes} [Tue Aug 9 11:10:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:10:49.793636 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-304a1595-6b01-4417-9e82-38940151aeb2 None None] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:10:49.794968 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-304a1595-6b01-4417-9e82-38940151aeb2 None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Aug 09 11:10:49.795706 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 3/4] 10.222.0.27 () {54 vars in 931 bytes} [Tue Aug 9 11:10:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:10:50.247769 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-81c6dab8-09bd-42bd-9462-7c014f5d6971 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "name": "cirros256", "disk": 1, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256}} {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:10:50.267992 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 11:10:50.267992 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: warnings.warn(msg) Aug 09 11:10:50.297133 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-81c6dab8-09bd-42bd-9462-7c014f5d6971 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.495093 Aug 09 11:10:50.297799 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 2/5] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Aug 9 11:10:49 2022] POST /compute/v2.1/flavors => generated 407 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 11:10:50.311449 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG dbcounter [-] [103159] Writing DB stats nova_api:SELECT=3 {{(pid=103159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:10:50.312727 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG dbcounter [-] [103159] Writing DB stats nova_cell0:SELECT=3 {{(pid=103159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:10:50.313683 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG dbcounter [-] [103159] Writing DB stats nova_cell1:SELECT=3 {{(pid=103159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:10:50.314391 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG dbcounter [-] [103159] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:10:50.522449 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-889c1c1c-b08c-47be-8b03-2dff76f3a7f8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:10:50.526840 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 11:10:50.526840 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: warnings.warn(msg) Aug 09 11:10:50.592487 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-889c1c1c-b08c-47be-8b03-2dff76f3a7f8 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.285652 Aug 09 11:10:50.604610 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 4/6] 10.222.0.27 () {64 vars in 1336 bytes} [Tue Aug 9 11:10:50 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:10:52.960581 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-81c6dab8-09bd-42bd-9462-7c014f5d6971 admin admin] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:10:52.961718 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-81c6dab8-09bd-42bd-9462-7c014f5d6971 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001652 Aug 09 11:10:52.962201 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 3/7] 10.222.0.27 () {54 vars in 931 bytes} [Tue Aug 9 11:10:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:10:53.622773 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-8ba1ac34-c992-42c6-a93b-81f82b196983 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 5, "name": "ds512M", "id": "d1", "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:10:53.643174 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 11:10:53.643174 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: warnings.warn(msg) Aug 09 11:10:53.663760 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-8ba1ac34-c992-42c6-a93b-81f82b196983 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.694974 Aug 09 11:10:53.664704 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 5/8] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Aug 9 11:10:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 11:10:53.676530 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-d71943fd-a8e7-4f91-b129-835711ba4c40 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:10:53.679345 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 11:10:53.679345 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: warnings.warn(msg) Aug 09 11:10:53.716028 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-d71943fd-a8e7-4f91-b129-835711ba4c40 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043145 Aug 09 11:10:53.728295 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 4/9] 10.222.0.27 () {64 vars in 1336 bytes} [Tue Aug 9 11:10:53 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:10:55.925669 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-8ba1ac34-c992-42c6-a93b-81f82b196983 admin admin] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:10:55.925669 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-8ba1ac34-c992-42c6-a93b-81f82b196983 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Aug 09 11:10:55.941647 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 6/10] 10.222.0.27 () {54 vars in 931 bytes} [Tue Aug 9 11:10:55 2022] GET /compute/v2.1 => generated 388 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:10:56.341795 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-78d51625-b42a-4090-9e61-0bbf817e4dd3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds1G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 10, "id": "d2", "ram": 1024}} {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:10:56.362158 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-78d51625-b42a-4090-9e61-0bbf817e4dd3 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.430638 Aug 09 11:10:56.362702 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 5/11] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Aug 9 11:10:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 11:10:56.375332 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-48678697-1bee-4cf1-835d-817cba7ad6f0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:10:56.409384 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-48678697-1bee-4cf1-835d-817cba7ad6f0 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037982 Aug 09 11:10:56.409925 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 7/12] 10.222.0.27 () {64 vars in 1336 bytes} [Tue Aug 9 11:10:56 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:10:58.601828 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-78d51625-b42a-4090-9e61-0bbf817e4dd3 admin admin] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:10:58.602852 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-78d51625-b42a-4090-9e61-0bbf817e4dd3 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Aug 09 11:10:58.603246 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 6/13] 10.222.0.27 () {54 vars in 931 bytes} [Tue Aug 9 11:10:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:10:59.063376 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-677be06b-030b-4224-9dde-157da6188ef7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 2, "ram": 2048, "id": "d3", "disk": 10, "os-flavor-access:is_public": true, "name": "ds2G", "swap": 0}} {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:10:59.090616 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-677be06b-030b-4224-9dde-157da6188ef7 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.480733 Aug 09 11:10:59.091182 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 8/14] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Aug 9 11:10:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 11:10:59.109274 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-a37a1b0d-ffc9-4b60-9e73-dca42a754848 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:10:59.134118 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-a37a1b0d-ffc9-4b60-9e73-dca42a754848 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028725 Aug 09 11:10:59.143261 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 7/15] 10.222.0.27 () {64 vars in 1336 bytes} [Tue Aug 9 11:10:59 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:11:01.335385 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-677be06b-030b-4224-9dde-157da6188ef7 admin admin] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:11:01.336396 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-677be06b-030b-4224-9dde-157da6188ef7 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Aug 09 11:11:01.337271 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 9/16] 10.222.0.27 () {54 vars in 931 bytes} [Tue Aug 9 11:11:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:11:01.764653 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-9b478df9-61c9-435d-a2cd-8a9756c0ae29 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 20, "os-flavor-access:is_public": true, "id": "d4", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "name": "ds4G", "rxtx_factor": 1.0}} {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:11:01.787284 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-9b478df9-61c9-435d-a2cd-8a9756c0ae29 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.444092 Aug 09 11:11:01.787940 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 8/17] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Aug 9 11:11:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 11:11:01.801260 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-d83396d4-96fe-4e49-b87b-c17f158e97f2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:11:01.830602 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-d83396d4-96fe-4e49-b87b-c17f158e97f2 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033351 Aug 09 11:11:01.831383 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 10/18] 10.222.0.27 () {64 vars in 1336 bytes} [Tue Aug 9 11:11:01 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:11:04.070176 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-9b478df9-61c9-435d-a2cd-8a9756c0ae29 admin admin] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:11:04.071488 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-9b478df9-61c9-435d-a2cd-8a9756c0ae29 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001915 Aug 09 11:11:04.071935 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 9/19] 10.222.0.27 () {54 vars in 931 bytes} [Tue Aug 9 11:11:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:11:04.532006 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-cf2706ab-3c21-42ff-96f3-ab9a2c0ea79d admin admin] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:11:04.557829 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-cf2706ab-3c21-42ff-96f3-ab9a2c0ea79d admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.478844 Aug 09 11:11:04.558422 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 11/20] 10.222.0.27 () {60 vars in 1292 bytes} [Tue Aug 9 11:11:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:11:06.818586 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-9b478df9-61c9-435d-a2cd-8a9756c0ae29 admin admin] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:11:06.819687 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-9b478df9-61c9-435d-a2cd-8a9756c0ae29 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Aug 09 11:11:06.820106 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 10/21] 10.222.0.27 () {54 vars in 931 bytes} [Tue Aug 9 11:11:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:11:07.284011 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-6c2b6395-7808-4b57-ae38-f48bddbfdd3a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "name": "m1.tiny", "id": "1", "os-flavor-access:is_public": true}} {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:11:07.305882 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-6c2b6395-7808-4b57-ae38-f48bddbfdd3a admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.479114 Aug 09 11:11:07.306455 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 12/22] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Aug 9 11:11:06 2022] POST /compute/v2.1/flavors => generated 402 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 11:11:07.320787 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-8a9f2acb-3128-43e6-8943-59bf08701ccf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:11:07.352707 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-8a9f2acb-3128-43e6-8943-59bf08701ccf admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036976 Aug 09 11:11:07.353467 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 11/23] 10.222.0.27 () {64 vars in 1333 bytes} [Tue Aug 9 11:11:07 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:11:09.563906 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-6c2b6395-7808-4b57-ae38-f48bddbfdd3a admin admin] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:11:09.565092 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-6c2b6395-7808-4b57-ae38-f48bddbfdd3a admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001683 Aug 09 11:11:09.565549 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 13/24] 10.222.0.27 () {54 vars in 931 bytes} [Tue Aug 9 11:11:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:11:09.966967 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-01cdd80b-41fe-423c-b40e-16be0f250b50 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "vcpus": 1, "disk": 20, "os-flavor-access:is_public": true, "ram": 2048, "name": "m1.small", "swap": 0}} {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:11:09.986718 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-01cdd80b-41fe-423c-b40e-16be0f250b50 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.415074 Aug 09 11:11:09.987274 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 12/25] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Aug 9 11:11:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 11:11:09.999764 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-1a7501e9-0f89-4318-afda-57e15a507bf0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:11:10.024952 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-1a7501e9-0f89-4318-afda-57e15a507bf0 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029016 Aug 09 11:11:10.025962 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 14/26] 10.222.0.27 () {64 vars in 1333 bytes} [Tue Aug 9 11:11:09 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:11:12.235938 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-01cdd80b-41fe-423c-b40e-16be0f250b50 admin admin] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:11:12.237136 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-01cdd80b-41fe-423c-b40e-16be0f250b50 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001629 Aug 09 11:11:12.237595 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 13/27] 10.222.0.27 () {54 vars in 931 bytes} [Tue Aug 9 11:11:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:11:12.640772 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-c732412a-0760-4053-952d-f6b1df531ac1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "name": "m1.medium", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "disk": 40}} {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:11:12.661241 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-c732412a-0760-4053-952d-f6b1df531ac1 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.416008 Aug 09 11:11:12.661932 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 15/28] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Aug 9 11:11:12 2022] POST /compute/v2.1/flavors => generated 406 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 11:11:12.674540 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-96559141-9cdb-4937-adcb-161f33ac4167 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:11:12.702279 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-96559141-9cdb-4937-adcb-161f33ac4167 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031369 Aug 09 11:11:12.702887 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 14/29] 10.222.0.27 () {64 vars in 1333 bytes} [Tue Aug 9 11:11:12 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:11:14.922234 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-c732412a-0760-4053-952d-f6b1df531ac1 admin admin] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:11:14.923244 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-c732412a-0760-4053-952d-f6b1df531ac1 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Aug 09 11:11:14.923636 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 16/30] 10.222.0.27 () {54 vars in 931 bytes} [Tue Aug 9 11:11:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:11:15.386600 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-96d499a4-22f8-4fe8-9d6e-3a9503b2d199 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "vcpus": 4, "os-flavor-access:is_public": true, "swap": 0, "ram": 8192, "name": "m1.large", "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:11:15.408747 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-96d499a4-22f8-4fe8-9d6e-3a9503b2d199 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.478819 Aug 09 11:11:15.409614 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 15/31] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Aug 9 11:11:14 2022] POST /compute/v2.1/flavors => generated 405 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 11:11:15.422465 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-467b1f2b-d38a-4350-a126-bb7ffde15fc2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:11:15.454171 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-467b1f2b-d38a-4350-a126-bb7ffde15fc2 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035780 Aug 09 11:11:15.455457 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 17/32] 10.222.0.27 () {64 vars in 1333 bytes} [Tue Aug 9 11:11:15 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:11:17.666468 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-96d499a4-22f8-4fe8-9d6e-3a9503b2d199 admin admin] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:11:17.667665 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-96d499a4-22f8-4fe8-9d6e-3a9503b2d199 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001648 Aug 09 11:11:17.668135 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 16/33] 10.222.0.27 () {54 vars in 931 bytes} [Tue Aug 9 11:11:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:11:18.094394 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-ee511219-9d5f-4cce-83ba-cf78cacf1dbe admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "disk": 160, "id": "5", "vcpus": 8, "name": "m1.xlarge", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:11:18.114398 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-ee511219-9d5f-4cce-83ba-cf78cacf1dbe admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.440023 Aug 09 11:11:18.115643 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 18/34] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Aug 9 11:11:17 2022] POST /compute/v2.1/flavors => generated 408 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 11:11:18.128542 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-6af2ef13-f467-411a-a241-8ff66919a6c6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:11:18.133476 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG dbcounter [-] [103158] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:18.163821 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-6af2ef13-f467-411a-a241-8ff66919a6c6 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039661 Aug 09 11:11:18.164576 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 17/35] 10.222.0.27 () {64 vars in 1333 bytes} [Tue Aug 9 11:11:18 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:11:38.153166 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-ee511219-9d5f-4cce-83ba-cf78cacf1dbe admin admin] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:11:38.154181 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-ee511219-9d5f-4cce-83ba-cf78cacf1dbe admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 Aug 09 11:11:38.154580 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 19/36] 10.222.0.27 () {54 vars in 931 bytes} [Tue Aug 9 11:11:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:11:38.569978 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-49769b12-6120-43ca-8ebd-8e5316a49a9f admin admin] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:11:38.588731 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-49769b12-6120-43ca-8ebd-8e5316a49a9f admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.428018 Aug 09 11:11:38.589276 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 18/37] 10.222.0.27 () {60 vars in 1292 bytes} [Tue Aug 9 11:11:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:11:39.674698 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-ee511219-9d5f-4cce-83ba-cf78cacf1dbe admin admin] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:11:39.675737 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-ee511219-9d5f-4cce-83ba-cf78cacf1dbe admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 09 11:11:39.676125 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 20/38] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Aug 9 11:11:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:11:40.226676 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-c12d439c-b8cc-4e28-901a-66089bb61a04 admin admin] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:11:40.232537 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.wsgi [None req-c12d439c-b8cc-4e28-901a-66089bb61a04 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 09 11:11:40.235779 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-c12d439c-b8cc-4e28-901a-66089bb61a04 admin admin] Request method failure captured: Aug 09 11:11:40.235779 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 09 11:11:40.235779 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: Accept: application/json Aug 09 11:11:40.235779 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: Accept-Encoding: gzip, deflate Aug 09 11:11:40.235779 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: Connection: keep-alive Aug 09 11:11:40.235779 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: Content-Length: 0 Aug 09 11:11:40.235779 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: Host: 10.222.0.27 Aug 09 11:11:40.235779 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: Openstack-Api-Version: compute 2.90 Aug 09 11:11:40.235779 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: Openstack-System-Scope: None Aug 09 11:11:40.235779 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: User-Agent: python-novaclient Aug 09 11:11:40.235779 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-Auth-Token: gAAAAABi8kDruWOlhFpzXwPCVV9hrRN7LFTSzpbq7IOnmvIcl3GqFgwQlQ1zUtPNYB-YMfBA_stxJraGACSo66O5x3OcoF9ceVDDqn6uvb6VhAzloALdcgAy2IAxmVIkgg65wjiHrwmmjnVbQdpGjbx6QrJLrTS0Vz86Rcg_StPmOjR5bvAU4EY Aug 09 11:11:40.235779 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-Domain-Id: None Aug 09 11:11:40.235779 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-Domain-Name: None Aug 09 11:11:40.235779 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-Identity-Status: Confirmed Aug 09 11:11:40.235779 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-Is-Admin-Project: True Aug 09 11:11:40.235779 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 11:11:40.235779 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-Project-Domain-Id: default Aug 09 11:11:40.235779 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-Project-Domain-Name: Default Aug 09 11:11:40.235779 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-Project-Id: 69344eba9b82497c957a2d6fd891ec79 Aug 09 11:11:40.235779 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-Project-Name: admin Aug 09 11:11:40.235779 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-Role: member,admin,reader Aug 09 11:11:40.235779 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-Roles: member,admin,reader Aug 09 11:11:40.237283 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/69344eba9b82497c957a2d6fd891ec79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_69344eba9b82497c957a2d6fd891ec79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/69344eba9b82497c957a2d6fd891ec79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/69344eba9b82497c957a2d6fd891ec79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:11:40.237283 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-Tenant: admin Aug 09 11:11:40.237283 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-Tenant-Id: 69344eba9b82497c957a2d6fd891ec79 Aug 09 11:11:40.237283 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-Tenant-Name: admin Aug 09 11:11:40.237283 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-User: admin Aug 09 11:11:40.237283 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-User-Domain-Id: default Aug 09 11:11:40.237283 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-User-Domain-Name: Default Aug 09 11:11:40.237283 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-User-Id: 9ebf3927bad74de89873a93b84ee2eae Aug 09 11:11:40.237283 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-User-Name: admin Aug 09 11:11:40.237283 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: method: > Aug 09 11:11:40.237283 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: exception: Flavor 42 could not be found. Aug 09 11:11:40.237283 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: action_args: {'id': '42'} Aug 09 11:11:40.237283 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:11:40.237283 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:11:40.238120 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 11:11:40.238120 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 11:11:40.238120 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 11:11:40.238120 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 11:11:40.238120 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 11:11:40.238120 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 11:11:40.238120 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 11:11:40.238120 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 11:11:40.238120 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 11:11:40.238120 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:11:40.238120 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 11:11:40.238120 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 11:11:40.238120 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 09 11:11:40.238120 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi Aug 09 11:11:40.238120 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:11:40.238120 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi Aug 09 11:11:40.238120 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:11:40.238120 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:11:40.238120 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:11:40.239596 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:11:40.239596 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:11:40.239596 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:11:40.239596 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:11:40.239596 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 11:11:40.239596 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:11:40.239596 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 09 11:11:40.239596 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi Aug 09 11:11:40.239596 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:11:40.239596 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi Aug 09 11:11:40.239596 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:11:40.239596 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:11:40.239596 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:11:40.239596 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:11:40.239596 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:11:40.239596 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 09 11:11:40.239596 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi Aug 09 11:11:40.239596 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-c12d439c-b8cc-4e28-901a-66089bb61a04 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:11:40.240985 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-c12d439c-b8cc-4e28-901a-66089bb61a04 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.424497 Aug 09 11:11:40.240985 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 19/39] 10.222.0.27 () {60 vars in 1190 bytes} [Tue Aug 9 11:11:39 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 426 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 11:11:40.247097 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-111a6eaa-c583-471b-999a-b446602ed2cb admin admin] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:11:40.251298 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG dbcounter [-] [103159] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:40.271194 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-111a6eaa-c583-471b-999a-b446602ed2cb admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027788 Aug 09 11:11:40.271931 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 21/40] 10.222.0.27 () {60 vars in 1210 bytes} [Tue Aug 9 11:11:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:11:40.281824 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-e1cdfd78-ec2b-4314-87ac-87119128326a admin admin] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:11:40.305934 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-e1cdfd78-ec2b-4314-87ac-87119128326a admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027695 Aug 09 11:11:40.306469 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 20/41] 10.222.0.27 () {60 vars in 1210 bytes} [Tue Aug 9 11:11:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:11:40.316096 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-25f69626-b343-43e1-832c-e8b5ed22b842 admin admin] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:11:40.322785 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.wsgi [None req-25f69626-b343-43e1-832c-e8b5ed22b842 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 09 11:11:40.326286 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-25f69626-b343-43e1-832c-e8b5ed22b842 admin admin] Request method failure captured: Aug 09 11:11:40.326286 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 09 11:11:40.326286 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: Accept: application/json Aug 09 11:11:40.326286 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: Accept-Encoding: gzip, deflate Aug 09 11:11:40.326286 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: Connection: keep-alive Aug 09 11:11:40.326286 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: Content-Length: 0 Aug 09 11:11:40.326286 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: Host: 10.222.0.27 Aug 09 11:11:40.326286 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: Openstack-Api-Version: compute 2.90 Aug 09 11:11:40.326286 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: Openstack-System-Scope: None Aug 09 11:11:40.326286 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: User-Agent: python-novaclient Aug 09 11:11:40.326286 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-Auth-Token: gAAAAABi8kDruWOlhFpzXwPCVV9hrRN7LFTSzpbq7IOnmvIcl3GqFgwQlQ1zUtPNYB-YMfBA_stxJraGACSo66O5x3OcoF9ceVDDqn6uvb6VhAzloALdcgAy2IAxmVIkgg65wjiHrwmmjnVbQdpGjbx6QrJLrTS0Vz86Rcg_StPmOjR5bvAU4EY Aug 09 11:11:40.326286 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-Domain-Id: None Aug 09 11:11:40.326286 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-Domain-Name: None Aug 09 11:11:40.326286 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-Identity-Status: Confirmed Aug 09 11:11:40.326286 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-Is-Admin-Project: True Aug 09 11:11:40.326286 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 11:11:40.326286 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-Project-Domain-Id: default Aug 09 11:11:40.326286 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-Project-Domain-Name: Default Aug 09 11:11:40.326286 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-Project-Id: 69344eba9b82497c957a2d6fd891ec79 Aug 09 11:11:40.326286 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-Project-Name: admin Aug 09 11:11:40.326286 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-Role: member,admin,reader Aug 09 11:11:40.326286 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-Roles: member,admin,reader Aug 09 11:11:40.327694 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/69344eba9b82497c957a2d6fd891ec79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_69344eba9b82497c957a2d6fd891ec79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/69344eba9b82497c957a2d6fd891ec79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/69344eba9b82497c957a2d6fd891ec79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:11:40.327694 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-Tenant: admin Aug 09 11:11:40.327694 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-Tenant-Id: 69344eba9b82497c957a2d6fd891ec79 Aug 09 11:11:40.327694 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-Tenant-Name: admin Aug 09 11:11:40.327694 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-User: admin Aug 09 11:11:40.327694 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-User-Domain-Id: default Aug 09 11:11:40.327694 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-User-Domain-Name: Default Aug 09 11:11:40.327694 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-User-Id: 9ebf3927bad74de89873a93b84ee2eae Aug 09 11:11:40.327694 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-User-Name: admin Aug 09 11:11:40.327694 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: method: > Aug 09 11:11:40.327694 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: exception: Flavor 42 could not be found. Aug 09 11:11:40.327694 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: action_args: {'id': '42'} Aug 09 11:11:40.327694 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:11:40.327694 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:11:40.328757 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 11:11:40.328757 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 11:11:40.328757 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 11:11:40.328757 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 11:11:40.328757 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 11:11:40.328757 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 11:11:40.328757 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 11:11:40.328757 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 11:11:40.328757 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 11:11:40.328757 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:11:40.328757 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 11:11:40.328757 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 11:11:40.328757 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 09 11:11:40.328757 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi Aug 09 11:11:40.328757 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:11:40.328757 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi Aug 09 11:11:40.328757 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:11:40.328757 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:11:40.328757 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:11:40.330075 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:11:40.330075 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:11:40.330075 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:11:40.330075 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:11:40.330075 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 11:11:40.330075 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:11:40.330075 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 09 11:11:40.330075 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi Aug 09 11:11:40.330075 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:11:40.330075 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi Aug 09 11:11:40.330075 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:11:40.330075 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:11:40.330075 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:11:40.330075 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:11:40.330075 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:11:40.330075 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 09 11:11:40.330075 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi Aug 09 11:11:40.330075 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-25f69626-b343-43e1-832c-e8b5ed22b842 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103159) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:11:40.331265 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-25f69626-b343-43e1-832c-e8b5ed22b842 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015146 Aug 09 11:11:40.331265 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 22/42] 10.222.0.27 () {60 vars in 1190 bytes} [Tue Aug 9 11:11:40 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 11:11:41.299645 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-e1cdfd78-ec2b-4314-87ac-87119128326a admin admin] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:11:41.300988 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-e1cdfd78-ec2b-4314-87ac-87119128326a admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Aug 09 11:11:41.301357 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 21/43] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Aug 9 11:11:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:11:41.866849 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-b2ff5e54-8081-469b-bc97-c18364807a27 admin admin] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:11:41.873226 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.wsgi [None req-b2ff5e54-8081-469b-bc97-c18364807a27 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 09 11:11:41.874721 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-b2ff5e54-8081-469b-bc97-c18364807a27 admin admin] Request method failure captured: Aug 09 11:11:41.874721 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 09 11:11:41.874721 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: Accept: application/json Aug 09 11:11:41.874721 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: Accept-Encoding: gzip, deflate Aug 09 11:11:41.874721 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: Connection: keep-alive Aug 09 11:11:41.874721 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: Content-Length: 0 Aug 09 11:11:41.874721 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: Host: 10.222.0.27 Aug 09 11:11:41.874721 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: Openstack-Api-Version: compute 2.90 Aug 09 11:11:41.874721 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: Openstack-System-Scope: None Aug 09 11:11:41.874721 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: User-Agent: python-novaclient Aug 09 11:11:41.874721 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-Auth-Token: gAAAAABi8kDtq6dJwI4MpCsL4IjrNoebB_KZJFDH85JdzmHUowqvROZRPwcv24Tv5Edxn3xOZlsQtUBrUKfL7qbWWzQqEwL2YeI5JyZZn15umjP79htePIo4ajPdQQYpbbm8FiM_dQH1RS_ORkFCIDFG6gKD0heG5epNX4tR0AqzGBmU-YDCT2Y Aug 09 11:11:41.874721 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-Domain-Id: None Aug 09 11:11:41.874721 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-Domain-Name: None Aug 09 11:11:41.874721 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-Identity-Status: Confirmed Aug 09 11:11:41.874721 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-Is-Admin-Project: True Aug 09 11:11:41.874721 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 11:11:41.874721 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-Project-Domain-Id: default Aug 09 11:11:41.874721 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-Project-Domain-Name: Default Aug 09 11:11:41.874721 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-Project-Id: 69344eba9b82497c957a2d6fd891ec79 Aug 09 11:11:41.874721 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-Project-Name: admin Aug 09 11:11:41.874721 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-Role: member,admin,reader Aug 09 11:11:41.874721 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-Roles: member,admin,reader Aug 09 11:11:41.876193 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/69344eba9b82497c957a2d6fd891ec79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_69344eba9b82497c957a2d6fd891ec79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/69344eba9b82497c957a2d6fd891ec79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/69344eba9b82497c957a2d6fd891ec79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:11:41.876193 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-Tenant: admin Aug 09 11:11:41.876193 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-Tenant-Id: 69344eba9b82497c957a2d6fd891ec79 Aug 09 11:11:41.876193 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-Tenant-Name: admin Aug 09 11:11:41.876193 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-User: admin Aug 09 11:11:41.876193 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-User-Domain-Id: default Aug 09 11:11:41.876193 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-User-Domain-Name: Default Aug 09 11:11:41.876193 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-User-Id: 9ebf3927bad74de89873a93b84ee2eae Aug 09 11:11:41.876193 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-User-Name: admin Aug 09 11:11:41.876193 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: method: > Aug 09 11:11:41.876193 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: exception: Flavor 84 could not be found. Aug 09 11:11:41.876193 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: action_args: {'id': '84'} Aug 09 11:11:41.876193 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:11:41.876193 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:11:41.877563 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 11:11:41.877563 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 11:11:41.877563 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 11:11:41.877563 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 11:11:41.877563 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 11:11:41.877563 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 11:11:41.877563 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 11:11:41.877563 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 11:11:41.877563 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 11:11:41.877563 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:11:41.877563 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 11:11:41.877563 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 11:11:41.877563 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 09 11:11:41.877563 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi Aug 09 11:11:41.877563 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:11:41.877563 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi Aug 09 11:11:41.877563 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:11:41.877563 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:11:41.877563 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:11:41.879631 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:11:41.879631 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:11:41.879631 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:11:41.879631 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:11:41.879631 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 11:11:41.879631 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:11:41.879631 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 09 11:11:41.879631 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi Aug 09 11:11:41.879631 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:11:41.879631 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi Aug 09 11:11:41.879631 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:11:41.879631 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:11:41.879631 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:11:41.879631 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:11:41.879631 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:11:41.879631 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 09 11:11:41.879631 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi Aug 09 11:11:41.879631 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-b2ff5e54-8081-469b-bc97-c18364807a27 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103159) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:11:41.881604 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-b2ff5e54-8081-469b-bc97-c18364807a27 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.436428 Aug 09 11:11:41.881604 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 23/44] 10.222.0.27 () {60 vars in 1190 bytes} [Tue Aug 9 11:11:41 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 438 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 11:11:41.890155 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-103e8805-4767-4e3d-b88d-56b084c2f6a2 admin admin] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:11:41.905808 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-103e8805-4767-4e3d-b88d-56b084c2f6a2 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020285 Aug 09 11:11:41.906352 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 22/45] 10.222.0.27 () {60 vars in 1210 bytes} [Tue Aug 9 11:11:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 11:11:41.916130 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-a5fafa50-3a17-4761-950d-afd0a27b838d admin admin] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:11:41.931852 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-a5fafa50-3a17-4761-950d-afd0a27b838d admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019297 Aug 09 11:11:41.932430 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 24/46] 10.222.0.27 () {60 vars in 1210 bytes} [Tue Aug 9 11:11:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:11:41.942371 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-0707cf50-7ead-4e62-b1b9-917329ea9135 admin admin] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:11:41.947910 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.wsgi [None req-0707cf50-7ead-4e62-b1b9-917329ea9135 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 09 11:11:41.949718 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-0707cf50-7ead-4e62-b1b9-917329ea9135 admin admin] Request method failure captured: Aug 09 11:11:41.949718 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 09 11:11:41.949718 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: Accept: application/json Aug 09 11:11:41.949718 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: Accept-Encoding: gzip, deflate Aug 09 11:11:41.949718 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: Connection: keep-alive Aug 09 11:11:41.949718 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: Content-Length: 0 Aug 09 11:11:41.949718 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: Host: 10.222.0.27 Aug 09 11:11:41.949718 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: Openstack-Api-Version: compute 2.90 Aug 09 11:11:41.949718 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: Openstack-System-Scope: None Aug 09 11:11:41.949718 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: User-Agent: python-novaclient Aug 09 11:11:41.949718 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-Auth-Token: gAAAAABi8kDtq6dJwI4MpCsL4IjrNoebB_KZJFDH85JdzmHUowqvROZRPwcv24Tv5Edxn3xOZlsQtUBrUKfL7qbWWzQqEwL2YeI5JyZZn15umjP79htePIo4ajPdQQYpbbm8FiM_dQH1RS_ORkFCIDFG6gKD0heG5epNX4tR0AqzGBmU-YDCT2Y Aug 09 11:11:41.949718 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-Domain-Id: None Aug 09 11:11:41.949718 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-Domain-Name: None Aug 09 11:11:41.949718 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-Identity-Status: Confirmed Aug 09 11:11:41.949718 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-Is-Admin-Project: True Aug 09 11:11:41.949718 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 11:11:41.949718 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-Project-Domain-Id: default Aug 09 11:11:41.949718 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-Project-Domain-Name: Default Aug 09 11:11:41.949718 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-Project-Id: 69344eba9b82497c957a2d6fd891ec79 Aug 09 11:11:41.949718 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-Project-Name: admin Aug 09 11:11:41.949718 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-Role: member,admin,reader Aug 09 11:11:41.949718 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-Roles: member,admin,reader Aug 09 11:11:41.951038 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/69344eba9b82497c957a2d6fd891ec79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_69344eba9b82497c957a2d6fd891ec79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/69344eba9b82497c957a2d6fd891ec79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/69344eba9b82497c957a2d6fd891ec79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:11:41.951038 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-Tenant: admin Aug 09 11:11:41.951038 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-Tenant-Id: 69344eba9b82497c957a2d6fd891ec79 Aug 09 11:11:41.951038 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-Tenant-Name: admin Aug 09 11:11:41.951038 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-User: admin Aug 09 11:11:41.951038 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-User-Domain-Id: default Aug 09 11:11:41.951038 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-User-Domain-Name: Default Aug 09 11:11:41.951038 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-User-Id: 9ebf3927bad74de89873a93b84ee2eae Aug 09 11:11:41.951038 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-User-Name: admin Aug 09 11:11:41.951038 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: method: > Aug 09 11:11:41.951038 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: exception: Flavor 84 could not be found. Aug 09 11:11:41.951038 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: action_args: {'id': '84'} Aug 09 11:11:41.951038 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:11:41.951038 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:11:41.951902 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 11:11:41.951902 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 11:11:41.951902 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 11:11:41.951902 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 11:11:41.951902 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 11:11:41.951902 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 11:11:41.951902 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 11:11:41.951902 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 11:11:41.951902 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 11:11:41.951902 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:11:41.951902 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 11:11:41.951902 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 11:11:41.951902 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 09 11:11:41.951902 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi Aug 09 11:11:41.951902 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:11:41.951902 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi Aug 09 11:11:41.951902 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:11:41.951902 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:11:41.951902 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:11:41.953235 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:11:41.953235 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:11:41.953235 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:11:41.953235 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:11:41.953235 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 11:11:41.953235 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:11:41.953235 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 09 11:11:41.953235 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi Aug 09 11:11:41.953235 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:11:41.953235 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi Aug 09 11:11:41.953235 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:11:41.953235 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:11:41.953235 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:11:41.953235 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:11:41.953235 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:11:41.953235 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 09 11:11:41.953235 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi Aug 09 11:11:41.953235 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-0707cf50-7ead-4e62-b1b9-917329ea9135 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:11:41.954600 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-0707cf50-7ead-4e62-b1b9-917329ea9135 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012433 Aug 09 11:11:41.954600 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 23/47] 10.222.0.27 () {60 vars in 1190 bytes} [Tue Aug 9 11:11:41 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 11:11:42.939256 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-a5fafa50-3a17-4761-950d-afd0a27b838d admin admin] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:11:42.940404 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-a5fafa50-3a17-4761-950d-afd0a27b838d admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001555 Aug 09 11:11:42.940870 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 25/48] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Aug 9 11:11:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:11:43.512502 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-b42844d6-575a-411b-bec3-9df328abce34 admin admin] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:11:43.518339 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.wsgi [None req-b42844d6-575a-411b-bec3-9df328abce34 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 09 11:11:43.519833 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-b42844d6-575a-411b-bec3-9df328abce34 admin admin] Request method failure captured: Aug 09 11:11:43.519833 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 09 11:11:43.519833 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: Accept: application/json Aug 09 11:11:43.519833 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: Accept-Encoding: gzip, deflate Aug 09 11:11:43.519833 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: Connection: keep-alive Aug 09 11:11:43.519833 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: Content-Length: 0 Aug 09 11:11:43.519833 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: Host: 10.222.0.27 Aug 09 11:11:43.519833 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: Openstack-Api-Version: compute 2.90 Aug 09 11:11:43.519833 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: Openstack-System-Scope: None Aug 09 11:11:43.519833 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: User-Agent: python-novaclient Aug 09 11:11:43.519833 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-Auth-Token: gAAAAABi8kDuPimFn-EtPsfv6p96F-6_fj7trkZYpkcPEoaIC9j61TOslgSwaX0xbskhQupyR9TDFRtuD6jS7dCobOZ39JbYqhmgh0ViAYQUeuiGfJr4e7Z_mMd2zdTC5STssCwS-lF1B8tQLf3mxiUcmfQNDcEAA15hdeanRMReq8Od76HvCpA Aug 09 11:11:43.519833 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-Domain-Id: None Aug 09 11:11:43.519833 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-Domain-Name: None Aug 09 11:11:43.519833 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-Identity-Status: Confirmed Aug 09 11:11:43.519833 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-Is-Admin-Project: True Aug 09 11:11:43.519833 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 11:11:43.519833 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-Project-Domain-Id: default Aug 09 11:11:43.519833 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-Project-Domain-Name: Default Aug 09 11:11:43.519833 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-Project-Id: 69344eba9b82497c957a2d6fd891ec79 Aug 09 11:11:43.519833 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-Project-Name: admin Aug 09 11:11:43.519833 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-Role: member,admin,reader Aug 09 11:11:43.519833 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-Roles: member,admin,reader Aug 09 11:11:43.521429 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/69344eba9b82497c957a2d6fd891ec79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_69344eba9b82497c957a2d6fd891ec79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/69344eba9b82497c957a2d6fd891ec79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/69344eba9b82497c957a2d6fd891ec79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:11:43.521429 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-Tenant: admin Aug 09 11:11:43.521429 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-Tenant-Id: 69344eba9b82497c957a2d6fd891ec79 Aug 09 11:11:43.521429 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-Tenant-Name: admin Aug 09 11:11:43.521429 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-User: admin Aug 09 11:11:43.521429 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-User-Domain-Id: default Aug 09 11:11:43.521429 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-User-Domain-Name: Default Aug 09 11:11:43.521429 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-User-Id: 9ebf3927bad74de89873a93b84ee2eae Aug 09 11:11:43.521429 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: X-User-Name: admin Aug 09 11:11:43.521429 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: method: > Aug 09 11:11:43.521429 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: exception: Flavor 451 could not be found. Aug 09 11:11:43.521429 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: action_args: {'id': '451'} Aug 09 11:11:43.521429 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:11:43.521429 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:11:43.522301 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 11:11:43.522301 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 11:11:43.522301 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 11:11:43.522301 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 11:11:43.522301 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 11:11:43.522301 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 11:11:43.522301 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 11:11:43.522301 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 11:11:43.522301 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 11:11:43.522301 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:11:43.522301 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 11:11:43.522301 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 11:11:43.522301 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 09 11:11:43.522301 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi Aug 09 11:11:43.522301 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:11:43.522301 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi Aug 09 11:11:43.522301 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:11:43.522301 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:11:43.522301 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:11:43.523696 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:11:43.523696 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:11:43.523696 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:11:43.523696 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:11:43.523696 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 11:11:43.523696 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:11:43.523696 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 09 11:11:43.523696 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi Aug 09 11:11:43.523696 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:11:43.523696 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi Aug 09 11:11:43.523696 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:11:43.523696 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:11:43.523696 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:11:43.523696 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:11:43.523696 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:11:43.523696 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 09 11:11:43.523696 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi Aug 09 11:11:43.523696 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-b42844d6-575a-411b-bec3-9df328abce34 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:11:43.524959 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-b42844d6-575a-411b-bec3-9df328abce34 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.443437 Aug 09 11:11:43.524959 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 24/49] 10.222.0.27 () {60 vars in 1193 bytes} [Tue Aug 9 11:11:43 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 444 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 11:11:43.531397 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-6a875bd8-5725-407b-baff-916106f69abe admin admin] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:11:43.546561 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-6a875bd8-5725-407b-baff-916106f69abe admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018846 Aug 09 11:11:43.547077 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 26/50] 10.222.0.27 () {60 vars in 1210 bytes} [Tue Aug 9 11:11:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:11:43.556777 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-dbf8684b-c74e-4c4b-b1bb-7cf9862bd923 admin admin] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:11:43.573175 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-dbf8684b-c74e-4c4b-b1bb-7cf9862bd923 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019947 Aug 09 11:11:43.573727 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 25/51] 10.222.0.27 () {60 vars in 1210 bytes} [Tue Aug 9 11:11:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:11:43.585867 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-94d0dd96-c8f8-4652-a45d-7a0332b82987 admin admin] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:11:43.591777 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.wsgi [None req-94d0dd96-c8f8-4652-a45d-7a0332b82987 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 09 11:11:43.593307 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-94d0dd96-c8f8-4652-a45d-7a0332b82987 admin admin] Request method failure captured: Aug 09 11:11:43.593307 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 09 11:11:43.593307 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: Accept: application/json Aug 09 11:11:43.593307 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: Accept-Encoding: gzip, deflate Aug 09 11:11:43.593307 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: Connection: keep-alive Aug 09 11:11:43.593307 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: Content-Length: 0 Aug 09 11:11:43.593307 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: Host: 10.222.0.27 Aug 09 11:11:43.593307 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: Openstack-Api-Version: compute 2.90 Aug 09 11:11:43.593307 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: Openstack-System-Scope: None Aug 09 11:11:43.593307 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: User-Agent: python-novaclient Aug 09 11:11:43.593307 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-Auth-Token: gAAAAABi8kDuPimFn-EtPsfv6p96F-6_fj7trkZYpkcPEoaIC9j61TOslgSwaX0xbskhQupyR9TDFRtuD6jS7dCobOZ39JbYqhmgh0ViAYQUeuiGfJr4e7Z_mMd2zdTC5STssCwS-lF1B8tQLf3mxiUcmfQNDcEAA15hdeanRMReq8Od76HvCpA Aug 09 11:11:43.593307 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-Domain-Id: None Aug 09 11:11:43.593307 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-Domain-Name: None Aug 09 11:11:43.593307 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-Identity-Status: Confirmed Aug 09 11:11:43.593307 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-Is-Admin-Project: True Aug 09 11:11:43.593307 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 11:11:43.593307 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-Project-Domain-Id: default Aug 09 11:11:43.593307 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-Project-Domain-Name: Default Aug 09 11:11:43.593307 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-Project-Id: 69344eba9b82497c957a2d6fd891ec79 Aug 09 11:11:43.593307 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-Project-Name: admin Aug 09 11:11:43.593307 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-Role: member,admin,reader Aug 09 11:11:43.593307 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-Roles: member,admin,reader Aug 09 11:11:43.594817 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/69344eba9b82497c957a2d6fd891ec79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_69344eba9b82497c957a2d6fd891ec79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/69344eba9b82497c957a2d6fd891ec79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/69344eba9b82497c957a2d6fd891ec79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:11:43.594817 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-Tenant: admin Aug 09 11:11:43.594817 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-Tenant-Id: 69344eba9b82497c957a2d6fd891ec79 Aug 09 11:11:43.594817 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-Tenant-Name: admin Aug 09 11:11:43.594817 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-User: admin Aug 09 11:11:43.594817 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-User-Domain-Id: default Aug 09 11:11:43.594817 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-User-Domain-Name: Default Aug 09 11:11:43.594817 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-User-Id: 9ebf3927bad74de89873a93b84ee2eae Aug 09 11:11:43.594817 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: X-User-Name: admin Aug 09 11:11:43.594817 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: method: > Aug 09 11:11:43.594817 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: exception: Flavor 451 could not be found. Aug 09 11:11:43.594817 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: action_args: {'id': '451'} Aug 09 11:11:43.594817 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:11:43.594817 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:11:43.595583 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 11:11:43.595583 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 11:11:43.595583 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 11:11:43.595583 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 11:11:43.595583 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 11:11:43.595583 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 11:11:43.595583 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 11:11:43.595583 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 11:11:43.595583 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 11:11:43.595583 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:11:43.595583 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 11:11:43.595583 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 11:11:43.595583 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 09 11:11:43.595583 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi Aug 09 11:11:43.595583 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:11:43.595583 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi Aug 09 11:11:43.595583 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:11:43.595583 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:11:43.595583 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:11:43.596671 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:11:43.596671 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:11:43.596671 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:11:43.596671 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:11:43.596671 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 11:11:43.596671 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:11:43.596671 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 09 11:11:43.596671 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi Aug 09 11:11:43.596671 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:11:43.596671 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi Aug 09 11:11:43.596671 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:11:43.596671 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:11:43.596671 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:11:43.596671 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:11:43.596671 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:11:43.596671 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 09 11:11:43.596671 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: ERROR nova.api.openstack.wsgi Aug 09 11:11:43.596671 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-94d0dd96-c8f8-4652-a45d-7a0332b82987 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103159) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:11:43.597809 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-94d0dd96-c8f8-4652-a45d-7a0332b82987 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012426 Aug 09 11:11:43.597809 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 27/52] 10.222.0.27 () {60 vars in 1193 bytes} [Tue Aug 9 11:11:43 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 11:11:44.587186 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-dbf8684b-c74e-4c4b-b1bb-7cf9862bd923 admin admin] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:11:44.588208 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-dbf8684b-c74e-4c4b-b1bb-7cf9862bd923 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 09 11:11:44.588667 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 26/53] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Aug 9 11:11:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:11:45.158890 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-6f74fd5e-33fb-40d7-832f-98c1942f025f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:11:45.186613 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-6f74fd5e-33fb-40d7-832f-98c1942f025f admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.460160 Aug 09 11:11:45.187164 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 28/54] 10.222.0.27 () {64 vars in 1235 bytes} [Tue Aug 9 11:11:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 11:11:46.171399 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-dbf8684b-c74e-4c4b-b1bb-7cf9862bd923 admin admin] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:11:46.172519 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-dbf8684b-c74e-4c4b-b1bb-7cf9862bd923 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Aug 09 11:11:46.172918 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 27/55] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Aug 9 11:11:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:11:46.735804 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-63a86158-c5a3-45e4-b0aa-98378526ab29 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:11:46.756939 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-63a86158-c5a3-45e4-b0aa-98378526ab29 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.447267 Aug 09 11:11:46.757528 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 29/56] 10.222.0.27 () {64 vars in 1235 bytes} [Tue Aug 9 11:11:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 11:11:47.761816 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-dbf8684b-c74e-4c4b-b1bb-7cf9862bd923 admin admin] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:11:47.762829 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-dbf8684b-c74e-4c4b-b1bb-7cf9862bd923 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001866 Aug 09 11:11:47.763226 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 28/57] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Aug 9 11:11:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:11:48.331502 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-72b9a514-1cb2-4269-9cce-6c133cf552e7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:11:48.353965 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-72b9a514-1cb2-4269-9cce-6c133cf552e7 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.445630 Aug 09 11:11:48.354527 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 30/58] 10.222.0.27 () {64 vars in 1235 bytes} [Tue Aug 9 11:11:47 2022] POST /compute/v2.1/flavors => generated 407 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 11:11:49.361688 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-dbf8684b-c74e-4c4b-b1bb-7cf9862bd923 admin admin] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:11:49.362939 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-dbf8684b-c74e-4c4b-b1bb-7cf9862bd923 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001969 Aug 09 11:11:49.363474 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 29/59] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Aug 9 11:11:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:11:49.939504 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-58afc654-f34c-4fcc-a9b2-df5f26062021 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:11:49.960300 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-58afc654-f34c-4fcc-a9b2-df5f26062021 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.451939 Aug 09 11:11:49.960816 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 31/60] 10.222.0.27 () {64 vars in 1235 bytes} [Tue Aug 9 11:11:49 2022] POST /compute/v2.1/flavors => generated 409 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 11:11:50.990234 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-dbf8684b-c74e-4c4b-b1bb-7cf9862bd923 admin admin] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:11:50.991306 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-dbf8684b-c74e-4c4b-b1bb-7cf9862bd923 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 09 11:11:50.991628 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 30/61] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Aug 9 11:11:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:11:51.683712 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-7d556a32-b9d5-4a99-a41d-6b0ab2e56581 admin admin] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:11:51.709052 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-7d556a32-b9d5-4a99-a41d-6b0ab2e56581 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.528998 Aug 09 11:11:51.709599 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 32/62] 10.222.0.27 () {60 vars in 1202 bytes} [Tue Aug 9 11:11:51 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:12:43.492450 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-dbf8684b-c74e-4c4b-b1bb-7cf9862bd923 admin admin] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:12:43.493469 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-dbf8684b-c74e-4c4b-b1bb-7cf9862bd923 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Aug 09 11:12:43.493863 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 31/63] 10.222.0.27 () {54 vars in 931 bytes} [Tue Aug 9 11:12:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:12:43.504975 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG dbcounter [-] [103159] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:43.930617 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-c22207ef-bc50-4020-a465-2bbbe4e623f3 admin admin] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:12:43.951049 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-c22207ef-bc50-4020-a465-2bbbe4e623f3 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.450629 Aug 09 11:12:43.951586 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 33/64] 10.222.0.27 () {60 vars in 1292 bytes} [Tue Aug 9 11:12:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:12:43.972676 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG dbcounter [-] [103158] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:43.976937 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-4d97abb8-0e83-448f-b124-1836416afb91 admin admin] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:12:43.986040 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-4d97abb8-0e83-448f-b124-1836416afb91 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014867 Aug 09 11:12:43.986558 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 32/65] 10.222.0.27 () {60 vars in 1283 bytes} [Tue Aug 9 11:12:43 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:12:43.998633 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-aefb0ec5-7940-4949-8c4a-a732281a4e75 admin admin] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:12:44.006900 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-aefb0ec5-7940-4949-8c4a-a732281a4e75 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011873 Aug 09 11:12:44.007419 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 34/66] 10.222.0.27 () {60 vars in 1286 bytes} [Tue Aug 9 11:12:43 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:12:44.020232 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-a08021a7-0c6a-4b0e-9a02-cb59811c961c admin admin] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:12:44.028230 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-a08021a7-0c6a-4b0e-9a02-cb59811c961c admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011968 Aug 09 11:12:44.028793 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 33/67] 10.222.0.27 () {60 vars in 1286 bytes} [Tue Aug 9 11:12:44 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:12:44.040164 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-bb7c382d-548c-492f-99ce-a9946bbfdbc0 admin admin] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:12:44.048083 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-bb7c382d-548c-492f-99ce-a9946bbfdbc0 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011423 Aug 09 11:12:44.048628 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 35/68] 10.222.0.27 () {60 vars in 1283 bytes} [Tue Aug 9 11:12:44 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:15:49.649595 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-a08021a7-0c6a-4b0e-9a02-cb59811c961c admin admin] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:15:49.650606 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-a08021a7-0c6a-4b0e-9a02-cb59811c961c admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Aug 09 11:15:49.651003 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 34/69] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Aug 9 11:15:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:15:49.790633 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG dbcounter [-] [103159] Writing DB stats nova_api:SELECT=6 {{(pid=103159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:15:49.976978 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-900e03be-ebb6-42c1-8b50-4bd48c6f62e6 admin admin] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:15:49.979333 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 11:15:49.979333 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: warnings.warn(msg) Aug 09 11:15:49.980481 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG oslo_concurrency.lockutils [None req-900e03be-ebb6-42c1-8b50-4bd48c6f62e6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103159) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:15:49.980952 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG oslo_concurrency.lockutils [None req-900e03be-ebb6-42c1-8b50-4bd48c6f62e6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103159) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:15:49.981374 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG oslo_concurrency.lockutils [None req-900e03be-ebb6-42c1-8b50-4bd48c6f62e6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103159) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:15:49.982081 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG oslo_concurrency.lockutils [None req-900e03be-ebb6-42c1-8b50-4bd48c6f62e6 admin admin] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103159) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:15:49.982522 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG oslo_concurrency.lockutils [None req-900e03be-ebb6-42c1-8b50-4bd48c6f62e6 admin admin] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103159) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:15:49.982937 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG oslo_concurrency.lockutils [None req-900e03be-ebb6-42c1-8b50-4bd48c6f62e6 admin admin] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103159) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:15:50.017010 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-900e03be-ebb6-42c1-8b50-4bd48c6f62e6 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.227983 Aug 09 11:15:50.017550 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 36/70] 10.222.0.27 () {60 vars in 1193 bytes} [Tue Aug 9 11:15:49 2022] GET /compute/v2.1/os-services => generated 791 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 11:15:50.864830 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-a08021a7-0c6a-4b0e-9a02-cb59811c961c admin admin] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:15:50.865848 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-a08021a7-0c6a-4b0e-9a02-cb59811c961c admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Aug 09 11:15:50.866243 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 35/71] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Aug 9 11:15:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:15:51.056614 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-ff12c363-3618-4d0b-bb86-cacef08aac87 admin admin] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:15:51.058996 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 11:15:51.058996 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: warnings.warn(msg) Aug 09 11:15:51.060110 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG oslo_concurrency.lockutils [None req-ff12c363-3618-4d0b-bb86-cacef08aac87 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103159) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:15:51.061348 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG oslo_concurrency.lockutils [None req-ff12c363-3618-4d0b-bb86-cacef08aac87 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103159) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:15:51.061830 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG oslo_concurrency.lockutils [None req-ff12c363-3618-4d0b-bb86-cacef08aac87 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103159) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:15:51.062592 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG oslo_concurrency.lockutils [None req-ff12c363-3618-4d0b-bb86-cacef08aac87 admin admin] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103159) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:15:51.063036 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG oslo_concurrency.lockutils [None req-ff12c363-3618-4d0b-bb86-cacef08aac87 admin admin] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103159) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:15:51.063614 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG oslo_concurrency.lockutils [None req-ff12c363-3618-4d0b-bb86-cacef08aac87 admin admin] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103159) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:15:51.083054 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-ff12c363-3618-4d0b-bb86-cacef08aac87 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.079011 Aug 09 11:15:51.083540 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 37/72] 10.222.0.27 () {60 vars in 1193 bytes} [Tue Aug 9 11:15:51 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 11:16:02.337329 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-a08021a7-0c6a-4b0e-9a02-cb59811c961c admin admin] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:16:02.338441 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-a08021a7-0c6a-4b0e-9a02-cb59811c961c admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 09 11:16:02.338856 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 36/73] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Aug 9 11:16:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:16:02.481930 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG dbcounter [-] [103159] Writing DB stats nova_cell0:SELECT=4 {{(pid=103159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:02.482660 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG dbcounter [-] [103159] Writing DB stats nova_cell1:SELECT=4 {{(pid=103159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:02.483266 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG dbcounter [-] [103159] Writing DB stats nova_api:SELECT=8 {{(pid=103159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:02.539770 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-b1ee95ba-c7ee-4cbd-9b06-a8fe05316c57 admin admin] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:16:02.542747 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 11:16:02.542747 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: warnings.warn(msg) Aug 09 11:16:02.543847 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG oslo_concurrency.lockutils [None req-b1ee95ba-c7ee-4cbd-9b06-a8fe05316c57 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103159) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:16:02.544337 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG oslo_concurrency.lockutils [None req-b1ee95ba-c7ee-4cbd-9b06-a8fe05316c57 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103159) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:16:02.544792 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG oslo_concurrency.lockutils [None req-b1ee95ba-c7ee-4cbd-9b06-a8fe05316c57 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103159) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:16:02.545482 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG oslo_concurrency.lockutils [None req-b1ee95ba-c7ee-4cbd-9b06-a8fe05316c57 admin admin] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103159) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:16:02.545943 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG oslo_concurrency.lockutils [None req-b1ee95ba-c7ee-4cbd-9b06-a8fe05316c57 admin admin] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103159) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:16:02.546352 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG oslo_concurrency.lockutils [None req-b1ee95ba-c7ee-4cbd-9b06-a8fe05316c57 admin admin] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103159) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:16:02.571299 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-b1ee95ba-c7ee-4cbd-9b06-a8fe05316c57 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.094099 Aug 09 11:16:02.571848 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 38/74] 10.222.0.27 () {60 vars in 1193 bytes} [Tue Aug 9 11:16:02 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:16:03.395500 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-a08021a7-0c6a-4b0e-9a02-cb59811c961c admin admin] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:16:03.396571 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-a08021a7-0c6a-4b0e-9a02-cb59811c961c admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Aug 09 11:16:03.396955 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 37/75] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Aug 9 11:16:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:16:03.602409 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG nova.api.openstack.wsgi [None req-4b73fc11-3e0c-4346-93b0-7667fcb7037d admin admin] Calling method '>' {{(pid=103159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:16:03.605838 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 11:16:03.605838 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: warnings.warn(msg) Aug 09 11:16:03.607465 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG oslo_concurrency.lockutils [None req-4b73fc11-3e0c-4346-93b0-7667fcb7037d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103159) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:16:03.608146 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG oslo_concurrency.lockutils [None req-4b73fc11-3e0c-4346-93b0-7667fcb7037d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103159) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:16:03.608780 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG oslo_concurrency.lockutils [None req-4b73fc11-3e0c-4346-93b0-7667fcb7037d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103159) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:16:03.609894 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG oslo_concurrency.lockutils [None req-4b73fc11-3e0c-4346-93b0-7667fcb7037d admin admin] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103159) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:16:03.610502 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG oslo_concurrency.lockutils [None req-4b73fc11-3e0c-4346-93b0-7667fcb7037d admin admin] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103159) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:16:03.611077 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: DEBUG oslo_concurrency.lockutils [None req-4b73fc11-3e0c-4346-93b0-7667fcb7037d admin admin] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103159) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:16:03.635898 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: INFO nova.api.openstack.requestlog [None req-4b73fc11-3e0c-4346-93b0-7667fcb7037d admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.101683 Aug 09 11:16:03.636468 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: [pid: 103159|app: 0|req: 39/76] 10.222.0.27 () {60 vars in 1193 bytes} [Tue Aug 9 11:16:03 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:17:01.898361 dv-cinder-852514-2-iscsi devstack@n-api.service[103157]: Tue Aug 9 11:17:01 2022 - graceful shutdown triggered... Aug 09 11:17:01.898500 dv-cinder-852514-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 09 11:17:01.899638 dv-cinder-852514-2-iscsi devstack@n-api.service[103158]: Gracefully killing worker 1 (pid: 103158)... Aug 09 11:17:01.900098 dv-cinder-852514-2-iscsi devstack@n-api.service[103159]: Gracefully killing worker 2 (pid: 103159)... Aug 09 11:17:02.900878 dv-cinder-852514-2-iscsi devstack@n-api.service[103157]: worker 1 buried after 1 seconds Aug 09 11:17:02.900878 dv-cinder-852514-2-iscsi devstack@n-api.service[103157]: worker 2 buried after 1 seconds Aug 09 11:17:02.900878 dv-cinder-852514-2-iscsi devstack@n-api.service[103157]: goodbye to uWSGI. Aug 09 11:17:02.903516 dv-cinder-852514-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 09 11:17:02.904462 dv-cinder-852514-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 09 11:17:02.908975 dv-cinder-852514-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 09 11:17:02.929927 dv-cinder-852514-2-iscsi devstack@n-api.service[117669]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 09 11:17:02.931986 dv-cinder-852514-2-iscsi devstack@n-api.service[117669]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 9 11:17:02 2022] *** Aug 09 11:17:02.931986 dv-cinder-852514-2-iscsi devstack@n-api.service[117669]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 09 11:17:02.931986 dv-cinder-852514-2-iscsi devstack@n-api.service[117669]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 09 11:17:02.931986 dv-cinder-852514-2-iscsi devstack@n-api.service[117669]: nodename: dv-cinder-852514-2-iscsi Aug 09 11:17:02.931986 dv-cinder-852514-2-iscsi devstack@n-api.service[117669]: machine: x86_64 Aug 09 11:17:02.931986 dv-cinder-852514-2-iscsi devstack@n-api.service[117669]: clock source: unix Aug 09 11:17:02.931986 dv-cinder-852514-2-iscsi devstack@n-api.service[117669]: pcre jit disabled Aug 09 11:17:02.931986 dv-cinder-852514-2-iscsi devstack@n-api.service[117669]: detected number of CPU cores: 4 Aug 09 11:17:02.931986 dv-cinder-852514-2-iscsi devstack@n-api.service[117669]: current working directory: / Aug 09 11:17:02.931986 dv-cinder-852514-2-iscsi devstack@n-api.service[117669]: detected binary path: /usr/bin/uwsgi-core Aug 09 11:17:02.931986 dv-cinder-852514-2-iscsi devstack@n-api.service[117669]: your processes number limit is 47680 Aug 09 11:17:02.931986 dv-cinder-852514-2-iscsi devstack@n-api.service[117669]: your memory page size is 4096 bytes Aug 09 11:17:02.931986 dv-cinder-852514-2-iscsi devstack@n-api.service[117669]: detected max file descriptor number: 2048 Aug 09 11:17:02.931986 dv-cinder-852514-2-iscsi devstack@n-api.service[117669]: lock engine: pthread robust mutexes Aug 09 11:17:02.933184 dv-cinder-852514-2-iscsi devstack@n-api.service[117669]: thunder lock: enabled Aug 09 11:17:02.933184 dv-cinder-852514-2-iscsi devstack@n-api.service[117669]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 09 11:17:02.933184 dv-cinder-852514-2-iscsi devstack@n-api.service[117669]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 09 11:17:02.973847 dv-cinder-852514-2-iscsi devstack@n-api.service[117669]: Python main interpreter initialized at 0x55904ec619c0 Aug 09 11:17:02.973847 dv-cinder-852514-2-iscsi devstack@n-api.service[117669]: python threads support enabled Aug 09 11:17:02.973847 dv-cinder-852514-2-iscsi devstack@n-api.service[117669]: your server socket listen backlog is limited to 100 connections Aug 09 11:17:02.973847 dv-cinder-852514-2-iscsi devstack@n-api.service[117669]: your mercy for graceful operations on workers is 90 seconds Aug 09 11:17:02.974441 dv-cinder-852514-2-iscsi devstack@n-api.service[117669]: mapped 403077 bytes (393 KB) for 2 cores Aug 09 11:17:02.974582 dv-cinder-852514-2-iscsi devstack@n-api.service[117669]: *** Operational MODE: preforking *** Aug 09 11:17:02.975043 dv-cinder-852514-2-iscsi devstack@n-api.service[117669]: *** uWSGI is running in multiple interpreter mode *** Aug 09 11:17:02.975043 dv-cinder-852514-2-iscsi devstack@n-api.service[117669]: spawned uWSGI master process (pid: 117669) Aug 09 11:17:02.975276 dv-cinder-852514-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 09 11:17:02.977068 dv-cinder-852514-2-iscsi devstack@n-api.service[117669]: spawned uWSGI worker 1 (pid: 117684, cores: 1) Aug 09 11:17:02.977720 dv-cinder-852514-2-iscsi devstack@n-api.service[117669]: spawned uWSGI worker 2 (pid: 117685, cores: 1) Aug 09 11:17:02.977917 dv-cinder-852514-2-iscsi devstack@n-api.service[117669]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 09 11:17:03.629772 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 09 11:17:03.642500 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 09 11:17:04.769873 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 11:17:04.769873 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: from cryptography.utils import int_from_bytes Aug 09 11:17:04.770558 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 11:17:04.770558 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: from cryptography.utils import int_from_bytes Aug 09 11:17:04.802056 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 11:17:04.802056 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: from cryptography.utils import int_from_bytes Aug 09 11:17:04.802766 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 11:17:04.802766 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: from cryptography.utils import int_from_bytes Aug 09 11:17:07.078911 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 11:17:07.079482 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 11:17:07.079672 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 11:17:07.080030 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 11:17:07.080299 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 11:17:07.080696 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.081010 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.081328 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.081640 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.081966 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.082269 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.082583 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.082895 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.083213 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.083466 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.084098 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.084447 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852514-2-iscsi {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.084766 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.085068 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.085377 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.085688 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.085985 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.086301 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.086611 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.087101 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.088544 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.088544 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.088544 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.088544 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.089811 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.089811 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.089811 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.089811 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.090377 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.090377 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.090666 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852514-2-iscsi {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.090897 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.091216 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.091521 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.091927 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.092233 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.092563 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.092859 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.093352 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.093674 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.093984 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.094475 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.094779 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.095231 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.095397 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.095699 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.096019 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.096338 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.096673 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.096964 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.097213 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.097533 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.097800 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.098147 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.098424 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.098671 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.098916 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.099311 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.099627 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.099960 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.100244 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.100552 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.100853 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.101154 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.101452 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.101751 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.102049 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.102361 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.102667 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.102983 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.103282 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.103593 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.103980 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.104224 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.104549 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.104880 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.105193 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.105494 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.105873 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.106115 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.106415 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.106712 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.107010 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.107321 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.107649 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.107947 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.108283 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.108509 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.108807 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.109119 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.109417 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.109717 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.110019 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.110314 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.110618 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.110918 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.111219 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.111515 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.111816 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.112113 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.112441 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.112738 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.113036 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.113349 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.113663 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.113964 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.114261 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.114558 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.114882 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.115263 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.115562 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.115876 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.116192 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.116519 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.116818 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.117131 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.117433 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.117735 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.118105 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.118378 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.118638 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.118947 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.119391 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.119524 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.119822 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.120334 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.120650 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.120953 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.121245 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.121549 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.121845 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.122158 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.122474 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.122780 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.123081 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.123377 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.123893 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.124430 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.124964 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.125494 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.125660 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 11:17:07.126108 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.126326 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.126516 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 11:17:07.126675 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.126964 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.127132 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 11:17:07.127292 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.127441 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 11:17:07.127597 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.127742 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 11:17:07.127937 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.128092 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.128734 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.128897 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.129054 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.129201 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.129352 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.129508 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.129671 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.129831 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.129983 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.130137 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.130289 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.130473 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.130681 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.130841 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.130996 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.131239 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.131448 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.131606 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.131780 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.131998 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.132146 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.132349 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852514-2-iscsi {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.132510 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.132657 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.132826 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.132972 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.133114 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.133267 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.133411 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.133563 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.133732 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.133886 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.134041 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.134186 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.134341 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.134597 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.134760 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.134760 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.135048 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.135212 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.135358 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.135525 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.135670 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.135813 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.135954 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.136188 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.136498 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.136668 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.136814 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.136967 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.137119 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.137263 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.137411 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.137571 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.137734 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.137922 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.138078 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.138230 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.138390 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.138554 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.138920 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852514-2-iscsi {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.139072 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.139216 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.139376 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.139376 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.139666 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.139820 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.139975 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.140118 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.140333 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.140487 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.140631 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.140773 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.140926 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.141070 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.141222 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.141374 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.141517 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.141668 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.141822 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.141976 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.142135 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.142280 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.142430 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.142582 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.142726 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.142878 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.143030 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.143182 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.143326 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.143468 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.143622 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.143788 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.143932 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.144075 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.144225 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.144406 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.144581 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.144813 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.144964 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.145108 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.145263 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.145407 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.145560 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.145715 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.145872 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.146032 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.146253 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.146494 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.146742 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.146917 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.147063 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.147216 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.147360 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.147505 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.147505 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.147798 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.147988 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.148136 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.148307 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.148476 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.148621 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.148764 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.148930 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.149207 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.149366 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.149521 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.149665 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.149808 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.149970 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.150124 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.150278 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.150433 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.150585 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.150735 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.150880 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.151022 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.151176 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.151327 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.151471 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.151614 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.151765 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.151925 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.152084 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.152236 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.152420 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.152566 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.152717 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.152869 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.153023 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.153176 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.153333 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.153484 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.153634 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.153788 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.153950 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.154112 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.154258 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.154258 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.154535 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.154678 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.154839 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.155066 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.155215 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.155368 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.155511 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.155654 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.155808 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.155969 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.156122 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.156313 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.156485 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.156725 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.156972 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.157158 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.157317 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.157464 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.157616 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.157761 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.157918 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.158114 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.158270 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.158415 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.158560 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.158703 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.158936 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.158936 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.159311 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.159460 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.159613 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.159766 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.159919 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.160063 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.160230 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.160406 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.160550 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.160705 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.160857 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.161001 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.161143 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.161285 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.161427 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.161585 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.161803 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.161956 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.162108 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.162270 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.162423 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.162578 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.162725 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.162876 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.163020 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.163162 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.163313 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.163471 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.163615 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.163615 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.163947 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.164112 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.164294 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.164455 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.164606 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.164606 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.164903 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.165065 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.165288 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.165445 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.165589 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.165743 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.165889 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.166040 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.166211 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.166211 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.166491 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.166645 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.166881 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.167131 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.167290 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.167436 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.167579 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.167737 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.167891 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.168036 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.168218 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.168409 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.168555 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.168713 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.168859 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.169011 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.169155 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.169326 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.169547 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.169714 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.169871 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.170024 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.170168 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.170168 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.170464 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.170610 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.170753 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.170904 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.171062 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.171207 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.171359 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.171520 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.171665 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.171808 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.171950 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.172104 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.172258 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.172482 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.172638 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.172782 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.172924 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.173074 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:07.173234 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.173379 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.173521 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.173521 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.173801 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.173958 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.174103 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.174257 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.174409 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.174560 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.174716 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.174877 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.175031 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.175175 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.175401 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.175559 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.175704 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.175861 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.176014 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.176199 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.176470 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.176470 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.176805 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.177035 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.177183 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.177364 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.177613 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.177772 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.177936 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.178082 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.178279 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.178438 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.178584 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.178746 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.178910 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.178910 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.179193 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.179364 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.179699 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.179859 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.180018 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.180171 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.180171 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.180490 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.180644 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.180799 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.180958 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.181111 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.181254 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.181405 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.181561 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.181715 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.181861 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.182010 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.182162 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.182317 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.182469 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.182628 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.182785 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.182785 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.183057 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.183199 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.183351 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.183505 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.183668 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.183820 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.183971 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.184124 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.184333 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.184485 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.184628 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.184798 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.184943 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.185093 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.185246 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.185417 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.185633 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.185782 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.185934 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.186088 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.186242 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.186386 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.186531 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.186680 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.186850 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.187011 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.187238 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.187396 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.187558 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.187806 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.187964 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.187964 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.188396 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.188550 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.188694 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.188838 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.189000 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.189196 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.189354 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.189500 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.189642 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.189888 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.190047 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.190208 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.190353 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.190496 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.190647 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.190791 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.190943 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.191112 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.191274 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.191427 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.191581 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.191726 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.191877 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.192021 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.192164 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.192357 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.192522 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.192667 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.192817 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.193042 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.193209 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.193354 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.193509 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.193653 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.193804 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.193948 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.194091 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.194242 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.194400 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.194554 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.194709 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.194863 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.195016 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.195186 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.195330 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.195330 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.195628 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.195841 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.195989 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.196142 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.196308 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.196458 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.196612 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.196764 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.196917 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.197080 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.197243 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.197466 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.197631 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.197801 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.198030 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.198194 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.198351 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.198537 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.198684 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.198837 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.198991 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.199137 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.199298 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.199451 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.199596 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.199748 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.199923 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.200143 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.200368 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.200577 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.200744 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.200891 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.201050 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.201203 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.201347 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.201502 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.201645 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.201788 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.201945 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.202089 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.202231 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.202382 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.202527 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.202680 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.202832 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.202976 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.203126 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.203279 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.203431 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.203585 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.203738 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.203884 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.204038 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.204182 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.204425 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.204604 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.204759 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.204918 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.205109 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.205261 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.205416 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.205575 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.205720 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.205888 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.206099 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.206256 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.206411 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.206556 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.206709 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.206862 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.206862 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.207144 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.207297 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.207478 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.207701 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.207859 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.208020 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.208253 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.208457 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.208683 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.208833 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.208985 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.209130 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.209273 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.209430 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.209600 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.209766 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.209921 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.210066 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.210311 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.210493 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.210640 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.210784 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.210929 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.211072 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.211225 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.211378 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.211522 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.211672 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.211833 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.211986 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.211986 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.212365 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.212523 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.212682 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.212849 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.212849 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.213166 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.213326 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.213478 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.213765 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.213950 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.214120 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.214282 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.214435 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.214594 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.214746 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.214896 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.215057 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.215057 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.215345 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.215494 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.215644 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.215802 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.215978 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.216218 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.216408 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.216578 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.216740 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.216902 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.217055 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.217206 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.217355 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.217513 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.217690 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.217925 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.218081 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.218262 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.218525 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.218734 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.218891 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.219057 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.219209 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.219368 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.219519 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.219668 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.219818 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.220055 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.220216 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.220482 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.220661 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.220813 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.220963 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.221124 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.221313 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.221468 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.221627 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.221779 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.221943 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.222103 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.222261 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.222413 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.222563 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.222723 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.222883 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.223044 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.223197 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.223347 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.223505 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.223665 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.223826 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.223978 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.224129 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.224438 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.224597 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.224759 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.224925 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.225086 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.225238 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.225395 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.225548 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.225716 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.225876 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.226027 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.226193 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.226419 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.226591 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.226761 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.226933 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.227093 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.227252 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.227410 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.227568 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.227787 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.227787 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.228176 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.228348 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.228533 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.228828 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.229003 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.229164 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.229335 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.229487 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.229646 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.229808 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.229961 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.230120 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.230120 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.230120 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.230653 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.230822 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.230976 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.231126 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.231284 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.231446 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.231598 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.231758 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.231919 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.232078 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.232230 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.232426 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.232590 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.232753 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.232906 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.233056 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.233206 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.233366 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.233527 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.233679 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.233838 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.233989 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.234138 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.234296 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.234456 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.234608 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.234767 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.234927 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.235080 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.235230 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.235418 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.235705 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.235871 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.236024 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.236183 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.236367 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.236593 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.236750 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.236918 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.237079 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.237230 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.237395 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.237555 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.237724 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.237875 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.238050 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.238274 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.238440 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.238744 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.239060 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.239213 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.239374 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.239526 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.239692 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.239889 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.240047 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.240047 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.240392 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.240545 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.240807 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.240975 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.241135 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.241135 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.241432 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.241595 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.241759 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.241919 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.242071 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.242071 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.242378 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.242538 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.242690 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.242840 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.242998 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.243150 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.243314 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.243468 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.243618 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.243768 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.243927 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.244080 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.244248 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.244437 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.244597 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.244756 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.244922 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.245082 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.245242 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.245394 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.245554 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.245724 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.245967 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.246133 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.246285 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.246447 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.246616 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.246768 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.246928 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.247089 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.247089 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.247378 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.247536 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.247698 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.247850 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.248000 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.248159 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.248454 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.248615 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.248780 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.249073 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.249243 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.249404 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.249564 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.249725 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.249891 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.250051 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.250211 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.250363 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.250522 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.250683 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.250940 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.251115 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.251276 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.251436 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.251587 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.251752 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.251914 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.252066 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.252216 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.252418 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.252571 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.252737 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.252901 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.253059 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.253585 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.253750 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.253902 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.254063 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.254214 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.254373 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.254532 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.254684 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.254841 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.255009 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.255161 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.255322 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.255570 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.255739 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.255901 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.256152 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.256339 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.256503 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.256656 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.256807 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.256982 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.257136 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.257296 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.257465 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.257632 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.257803 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.258382 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.258628 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.258786 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.258937 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.259157 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.259407 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.259580 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.259732 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.259892 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.260052 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.260216 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.260405 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.260566 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.260718 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.260868 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.261107 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.261265 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.261431 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.261592 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.261756 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.261909 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.262066 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.262218 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.262389 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.262543 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.262701 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.262852 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.263013 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.263166 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.263333 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.263491 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.263650 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.263801 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.263952 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.264112 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.264289 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.264289 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.264598 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.264598 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.264894 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.265055 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.265215 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.265366 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.265517 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.265666 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.265824 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.265985 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.266163 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.266384 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.266561 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.266712 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.266871 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.267032 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.267185 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.267335 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.267500 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.267660 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.267825 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.267977 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.268126 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.268336 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.268510 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.268754 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.268927 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.269087 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.269281 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.269456 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.269695 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.269851 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.270011 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.270163 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.270313 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.270462 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.270620 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.270790 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.270957 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.271224 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.271385 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.271546 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.271714 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.271874 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.272026 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.272177 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.272177 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.272498 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.272669 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.272824 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.272985 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.273136 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.273286 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.273437 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.273596 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.273748 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.273915 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.274075 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.274233 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.274398 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.274550 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.274700 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.274869 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.275021 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.275021 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.275325 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.275528 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.275685 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.275685 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.275982 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.276133 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.276360 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.276593 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.276862 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.277022 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.277193 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.277361 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.277522 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.277684 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.277843 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.278003 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.278163 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.278325 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.278486 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.278646 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.278893 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.279065 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.279273 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.279444 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.279613 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.279767 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.280020 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.280020 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.280020 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.280020 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.280020 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.280020 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.280020 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.281049 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.281298 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.281462 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.281613 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.281763 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.281921 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.282080 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.282246 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.282407 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.282558 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.282710 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.282860 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.283025 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.283178 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.283340 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.283490 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.283640 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.283790 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.283953 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.284106 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.284318 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.284479 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.284642 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.284793 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.284958 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.285117 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.285287 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.285488 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.285652 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.285812 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.285976 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.286138 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.286297 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.286466 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.286639 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.286949 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.287117 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.287269 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.287421 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.287583 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.287742 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.287904 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.288057 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.288207 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.288382 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.288535 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.288685 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.288870 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.289133 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.289333 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.289498 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.289651 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.289820 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.289982 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.290236 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.290399 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.290560 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.290712 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.290879 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.291031 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.291191 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.291351 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.291503 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.291663 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.291825 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.292006 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.292167 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.292358 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.292517 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.292678 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.292839 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.292991 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.293148 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.293299 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.293457 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.293608 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.293769 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.293931 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.294091 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.294242 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.294400 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.294561 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.294713 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.294864 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.295013 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.295163 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.295321 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.295515 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.295670 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.295830 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.295830 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.296128 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.296318 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.296499 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.296652 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.296652 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.296652 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.297177 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.297334 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.297495 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.297655 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.297817 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.297970 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.298139 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.298302 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.298454 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.298611 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.298763 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.298922 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.299091 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.299321 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.299517 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.299680 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.299842 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.300004 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.300156 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.300482 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.300718 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.300895 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.301051 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.301201 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.301358 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.301525 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.301678 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.301864 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.302019 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.302180 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.302180 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.302545 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.302698 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.302849 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.302999 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.303150 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.303310 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.303471 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.303631 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.303783 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.303933 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.304082 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.304242 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.304416 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.304717 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.304888 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.305054 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.305216 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.305380 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.305532 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.305532 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.305818 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.305968 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.306128 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.306289 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.306457 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.306611 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.306772 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.306923 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.307083 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.307328 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.307496 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.307650 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.307800 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.307950 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.308116 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.308330 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.308505 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.309228 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.309489 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.309716 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.309872 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.309872 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.310159 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.310310 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.310464 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.310629 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.310791 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.310943 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.311095 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.311271 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.311520 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.311698 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.311853 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.312013 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.312172 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.312342 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.312509 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.312747 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.312909 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.313061 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.313212 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.313362 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.313530 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.313683 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.313972 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.314142 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.314296 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.314455 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.314455 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.314455 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.314907 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.315057 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.315206 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.315365 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.315531 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.315685 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.315848 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.315998 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.316156 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.316363 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.316528 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.316681 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.316834 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.316993 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.317157 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.317337 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.317594 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.317767 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.317967 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.318177 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.318339 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.318501 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.318661 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.318814 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.318974 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.319133 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.319285 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.319445 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.319722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.319880 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.320032 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.320205 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.320398 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.320552 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.320703 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.320862 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.321014 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.321164 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.321324 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.321501 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.321749 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.321908 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.322069 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.322228 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.322400 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.322400 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.322694 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.322933 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.323155 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.323155 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.324661 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.324889 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.325059 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.325226 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.325380 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.325540 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.325713 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.325881 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.326044 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.326198 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.326356 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.326511 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.326662 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.326821 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.326988 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.327149 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.327309 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.327461 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.327729 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.327896 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.328059 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.328212 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.328424 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.328586 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.328746 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.328905 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.329075 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.329227 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.329379 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.329530 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.329806 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.329979 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.330145 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.330297 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.330297 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.330601 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.330752 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.330752 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.331058 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.331219 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.331378 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.331540 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.331693 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.331973 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.332156 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.332339 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.332497 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.332656 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.332656 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.332965 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.333125 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.333284 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.333443 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.333650 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.333818 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.333971 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.334134 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.334295 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.334448 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.334600 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.334761 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.334761 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.335051 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.335203 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.335353 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.335514 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.335676 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.335836 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.335988 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.336462 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.336630 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.336800 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.336954 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.337113 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.337274 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.337426 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.337867 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.338048 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.338213 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.338378 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.338571 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.338864 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.339100 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.339271 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.339424 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.339576 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.339727 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.340016 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.340191 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.340382 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.340545 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.340698 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.340857 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.341022 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.341184 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.341344 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.341496 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.341646 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.341797 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.341977 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.342289 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.342457 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.342611 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.342770 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.342957 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.343137 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.343299 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.343460 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.343612 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.343771 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.343930 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.344096 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.344256 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.344444 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.344597 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.344748 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.344748 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.345135 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.345303 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.345456 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.345613 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.345767 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.345934 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.346087 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.346238 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.346400 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.346561 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.346729 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.346904 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.347058 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.347222 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.347373 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.347532 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.347693 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.347874 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.348147 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.348357 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.348526 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.348679 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.348830 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.348996 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.349157 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.349410 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 11:17:07.349599 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.349599 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.349599 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.349599 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.349599 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.349599 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.349599 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.349599 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.350995 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.350995 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.350995 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.350995 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.350995 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.350995 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.350995 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.350995 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.352181 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.352181 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.352181 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.352181 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.352181 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.352181 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.352181 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.352181 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.353357 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.353357 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.353357 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.353357 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.353357 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.353357 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.353357 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.353357 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.354523 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.354523 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.354523 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.354523 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.354523 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.354523 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.354523 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.354523 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.355657 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.355657 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.355657 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.355657 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.355657 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.355657 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.355657 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.355657 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.356919 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.356919 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.356919 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.356919 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.356919 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.356919 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.356919 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.356919 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.358069 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.358069 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.358069 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.358069 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.358069 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.358069 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.358069 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.358069 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.359318 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.359318 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.359318 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.359318 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.359318 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.359318 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.359318 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.359318 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.360523 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.360523 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.360523 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.360523 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.360523 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.360523 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.360523 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.360523 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.361771 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.361771 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.361771 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.361771 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.361771 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.361771 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.361771 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.362858 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.362858 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.362858 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.363317 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.363317 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.363612 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.363891 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.364439 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.364622 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.364951 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.365914 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.366309 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.366727 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.366950 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.367290 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.367606 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.367917 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.368229 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.368577 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.368902 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.369219 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.369527 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.369833 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.370149 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.370527 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.370765 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.371091 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.371446 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.371710 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.372026 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.372357 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.372672 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.372987 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.373298 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.373617 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.373928 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.374234 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.374542 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.374847 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.375171 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.375472 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.375820 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.376162 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.376513 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.376841 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.377179 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.377506 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.377819 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.378470 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.378802 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.379124 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.379442 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.379780 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.380090 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.380485 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.381515 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.381847 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.382166 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.382483 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.382829 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.383162 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.383474 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.383805 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.384129 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.384490 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.384813 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.385128 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.385460 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.385775 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.386088 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.386433 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.386721 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.387033 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.387353 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.387672 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.387985 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.388442 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.388636 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.388973 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.389413 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.389696 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.389927 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.390281 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.390612 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.390934 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.391283 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.391616 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.391933 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.392248 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.392580 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:07.392826 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 11:17:07.498398 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO dbcounter [None req-c1af06d0-c7d8-4988-b28e-d803f6aa121d None None] Registered counter for database nova_api Aug 09 11:17:07.524293 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_db.sqlalchemy.engines [None req-c1af06d0-c7d8-4988-b28e-d803f6aa121d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117684) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 11:17:07.526338 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writer thread running {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 11:17:07.560798 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO dbcounter [None req-1a23a53a-56c4-41bf-8f4e-6e83f8528d63 None None] Registered counter for database nova_api Aug 09 11:17:07.582213 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_db.sqlalchemy.engines [None req-1a23a53a-56c4-41bf-8f4e-6e83f8528d63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117685) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 11:17:07.582439 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.context [None req-c1af06d0-c7d8-4988-b28e-d803f6aa121d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ad0e4d4c-ebcc-4363-b137-c73e7b855b1b(cell1) {{(pid=117684) load_cells /opt/stack/nova/nova/context.py:464}} Aug 09 11:17:07.587059 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c1af06d0-c7d8-4988-b28e-d803f6aa121d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:17:07.587427 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c1af06d0-c7d8-4988-b28e-d803f6aa121d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:17:07.589067 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c1af06d0-c7d8-4988-b28e-d803f6aa121d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:17:07.589796 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c1af06d0-c7d8-4988-b28e-d803f6aa121d None None] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:17:07.590226 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c1af06d0-c7d8-4988-b28e-d803f6aa121d None None] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:17:07.590672 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writer thread running {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 11:17:07.592274 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c1af06d0-c7d8-4988-b28e-d803f6aa121d None None] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:17:07.594341 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO dbcounter [None req-c1af06d0-c7d8-4988-b28e-d803f6aa121d None None] Registered counter for database nova_cell0 Aug 09 11:17:07.599039 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO dbcounter [None req-c1af06d0-c7d8-4988-b28e-d803f6aa121d None None] Registered counter for database nova_cell1 Aug 09 11:17:07.608941 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_db.sqlalchemy.engines [None req-c1af06d0-c7d8-4988-b28e-d803f6aa121d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117684) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 11:17:07.610129 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_db.sqlalchemy.engines [None req-c1af06d0-c7d8-4988-b28e-d803f6aa121d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117684) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 11:17:07.616059 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writer thread running {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 11:17:07.651315 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.context [None req-1a23a53a-56c4-41bf-8f4e-6e83f8528d63 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ad0e4d4c-ebcc-4363-b137-c73e7b855b1b(cell1) {{(pid=117685) load_cells /opt/stack/nova/nova/context.py:464}} Aug 09 11:17:07.655472 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1a23a53a-56c4-41bf-8f4e-6e83f8528d63 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:17:07.655942 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1a23a53a-56c4-41bf-8f4e-6e83f8528d63 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:17:07.657555 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1a23a53a-56c4-41bf-8f4e-6e83f8528d63 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:17:07.658306 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1a23a53a-56c4-41bf-8f4e-6e83f8528d63 None None] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:17:07.658749 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1a23a53a-56c4-41bf-8f4e-6e83f8528d63 None None] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:17:07.660761 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1a23a53a-56c4-41bf-8f4e-6e83f8528d63 None None] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:17:07.663439 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO dbcounter [None req-1a23a53a-56c4-41bf-8f4e-6e83f8528d63 None None] Registered counter for database nova_cell0 Aug 09 11:17:07.667547 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO dbcounter [None req-1a23a53a-56c4-41bf-8f4e-6e83f8528d63 None None] Registered counter for database nova_cell1 Aug 09 11:17:07.675579 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_db.sqlalchemy.engines [None req-1a23a53a-56c4-41bf-8f4e-6e83f8528d63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117685) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 11:17:07.679021 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_db.sqlalchemy.engines [None req-1a23a53a-56c4-41bf-8f4e-6e83f8528d63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117685) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 11:17:07.691568 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writer thread running {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 11:17:07.693033 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writer thread running {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 11:17:07.754986 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writer thread running {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 11:17:07.764393 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO dbcounter [None req-c1af06d0-c7d8-4988-b28e-d803f6aa121d None None] Registered counter for database nova_cell0 Aug 09 11:17:07.771088 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_db.sqlalchemy.engines [None req-c1af06d0-c7d8-4988-b28e-d803f6aa121d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117684) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 11:17:07.776074 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writer thread running {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 11:17:07.842516 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO dbcounter [None req-1a23a53a-56c4-41bf-8f4e-6e83f8528d63 None None] Registered counter for database nova_cell0 Aug 09 11:17:07.850565 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_db.sqlalchemy.engines [None req-1a23a53a-56c4-41bf-8f4e-6e83f8528d63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117685) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 11:17:07.855595 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writer thread running {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 11:17:08.088908 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: WARNING keystonemiddleware.auth_token [None req-c1af06d0-c7d8-4988-b28e-d803f6aa121d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 11:17:08.096213 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: WARNING keystonemiddleware.auth_token [None req-c1af06d0-c7d8-4988-b28e-d803f6aa121d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 11:17:08.179125 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: WARNING keystonemiddleware.auth_token [None req-1a23a53a-56c4-41bf-8f4e-6e83f8528d63 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 11:17:08.186528 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: WARNING keystonemiddleware.auth_token [None req-1a23a53a-56c4-41bf-8f4e-6e83f8528d63 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 11:17:08.441346 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: WARNING keystonemiddleware.auth_token [None req-c1af06d0-c7d8-4988-b28e-d803f6aa121d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 11:17:08.447774 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: WARNING keystonemiddleware.auth_token [None req-c1af06d0-c7d8-4988-b28e-d803f6aa121d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 11:17:08.454823 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55904ec619c0 pid: 117684 (default app) Aug 09 11:17:08.548968 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: WARNING keystonemiddleware.auth_token [None req-1a23a53a-56c4-41bf-8f4e-6e83f8528d63 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 11:17:08.555462 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: WARNING keystonemiddleware.auth_token [None req-1a23a53a-56c4-41bf-8f4e-6e83f8528d63 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 11:17:08.561780 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55904ec619c0 pid: 117685 (default app) Aug 09 11:17:42.265970 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_api:SELECT=3 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:17:42.267117 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell1:SELECT=3 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:17:42.267791 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell0:SELECT=3 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:17:42.268834 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell0:SELECT=3 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:17:43.208863 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-e37ed4ad-26de-44d9-a037-3c814a6fff28 tempest-VolumesGetTestJSON-585415136 tempest-VolumesGetTestJSON-585415136-project] Action: 'create', calling method: .version_select at 0x7f2824061e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-719971195", "metadata": {"Type": "work"}}} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:17:44.628771 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-e37ed4ad-26de-44d9-a037-3c814a6fff28 tempest-VolumesGetTestJSON-585415136 tempest-VolumesGetTestJSON-585415136-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.377110 Aug 09 11:17:44.629599 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 1/1] 10.222.0.27 () {60 vars in 1156 bytes} [Tue Aug 9 11:17:42 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2380 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 09 11:17:44.651160 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_api:SELECT=3 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:17:44.651797 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell1:SELECT=3 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:17:44.654445 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell0:SELECT=3 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:17:44.658405 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell0:SELECT=3 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:17:45.071684 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-0522f8ee-bbd1-4d95-b249-3e75dd6f6562 tempest-VolumesGetTestJSON-585415136 tempest-VolumesGetTestJSON-585415136-project] Calling method '.version_select at 0x7f2824021a60>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:17:46.087400 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-0522f8ee-bbd1-4d95-b249-3e75dd6f6562 tempest-VolumesGetTestJSON-585415136 tempest-VolumesGetTestJSON-585415136-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/dbe86013-dfcb-4322-a8af-c540deb82c1e" status: 200 len: 353 microversion: 2.1 time: 1.444189 Aug 09 11:17:46.088329 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 1/2] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 9 11:17:44 2022] GET /compute/v2.1/os-volumes/dbe86013-dfcb-4322-a8af-c540deb82c1e => generated 353 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:17:46.102001 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-672f5a4d-87bc-4463-aa29-2804c6e8b1ac tempest-VolumesGetTestJSON-585415136 tempest-VolumesGetTestJSON-585415136-project] Calling method '.version_select at 0x7f2823ea2ca0>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:17:46.207095 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-672f5a4d-87bc-4463-aa29-2804c6e8b1ac tempest-VolumesGetTestJSON-585415136 tempest-VolumesGetTestJSON-585415136-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/dbe86013-dfcb-4322-a8af-c540deb82c1e" status: 200 len: 353 microversion: 2.1 time: 0.109637 Aug 09 11:17:46.207934 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 2/3] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 9 11:17:46 2022] GET /compute/v2.1/os-volumes/dbe86013-dfcb-4322-a8af-c540deb82c1e => generated 353 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:17:46.222701 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-e723b234-a82f-4465-b80a-1fb96bb0f778 tempest-VolumesGetTestJSON-585415136 tempest-VolumesGetTestJSON-585415136-project] Calling method '.version_select at 0x7f2823e67c10>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:17:46.346117 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-8932674e-fd8b-482a-b2a0-14ad8b74abcb tempest-VolumesTestJSON-1622169248 tempest-VolumesTestJSON-1622169248-project] Calling method '.version_select at 0x7f2823e3f3a0>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:17:46.464368 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-e723b234-a82f-4465-b80a-1fb96bb0f778 tempest-VolumesGetTestJSON-585415136 tempest-VolumesGetTestJSON-585415136-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/dbe86013-dfcb-4322-a8af-c540deb82c1e" status: 202 len: 0 microversion: 2.1 time: 0.245830 Aug 09 11:17:46.465440 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 2/4] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Aug 9 11:17:46 2022] DELETE /compute/v2.1/os-volumes/dbe86013-dfcb-4322-a8af-c540deb82c1e => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:17:46.475587 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-9c123d2c-a213-4602-ab86-7c3827253e6d tempest-VolumesGetTestJSON-585415136 tempest-VolumesGetTestJSON-585415136-project] Calling method '.version_select at 0x7f2823e26310>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:17:46.738394 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-8932674e-fd8b-482a-b2a0-14ad8b74abcb tempest-VolumesTestJSON-1622169248 tempest-VolumesTestJSON-1622169248-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/37e1c4e3-b07b-446b-ad2a-a982bfcdeeb6" status: 200 len: 350 microversion: 2.1 time: 0.396991 Aug 09 11:17:46.739227 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 3/5] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 9 11:17:46 2022] GET /compute/v2.1/os-volumes/37e1c4e3-b07b-446b-ad2a-a982bfcdeeb6 => generated 350 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:17:46.790885 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.wsgi [None req-9c123d2c-a213-4602-ab86-7c3827253e6d tempest-VolumesGetTestJSON-585415136 tempest-VolumesGetTestJSON-585415136-project] HTTP exception thrown: Volume dbe86013-dfcb-4322-a8af-c540deb82c1e could not be found. Aug 09 11:17:46.796722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-9c123d2c-a213-4602-ab86-7c3827253e6d tempest-VolumesGetTestJSON-585415136 tempest-VolumesGetTestJSON-585415136-project] Request method failure captured: Aug 09 11:17:46.796722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: request: GET /compute/v2.1/os-volumes/dbe86013-dfcb-4322-a8af-c540deb82c1e HTTP/1.1 Aug 09 11:17:46.796722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Accept: application/json Aug 09 11:17:46.796722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Accept-Encoding: identity Aug 09 11:17:46.796722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Connection: close Aug 09 11:17:46.796722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Content-Length: 0 Aug 09 11:17:46.796722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Content-Type: application/json Aug 09 11:17:46.796722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Host: 10.222.0.27 Aug 09 11:17:46.796722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Openstack-System-Scope: None Aug 09 11:17:46.796722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: User-Agent: python-urllib3/1.26.11 Aug 09 11:17:46.796722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Auth-Token: gAAAAABi8kJWxWPIjLVmW6gcXcgv-WkHFigIDenJXVZh3CirxiHU5G68BDNTDdJvfMU61V1g1j_F3u0ypohc31w3ydql5FDS_t6Xzvmk873T1fMV8ftn3rktbkNSjAY71zlJhUpuGdfnJL1Fw6f4EBXCl1oUw4ehXSRiPswYv5aR27RvldxM43k Aug 09 11:17:46.796722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Domain-Id: None Aug 09 11:17:46.796722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Domain-Name: None Aug 09 11:17:46.796722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Identity-Status: Confirmed Aug 09 11:17:46.796722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Is-Admin-Project: True Aug 09 11:17:46.796722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Domain-Id: default Aug 09 11:17:46.796722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Domain-Name: Default Aug 09 11:17:46.796722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Id: 0487db6164f74d63ae08bfc5607ee4cc Aug 09 11:17:46.796722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Name: tempest-VolumesGetTestJSON-585415136 Aug 09 11:17:46.796722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Role: member,reader Aug 09 11:17:46.796722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Roles: member,reader Aug 09 11:17:46.798416 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0487db6164f74d63ae08bfc5607ee4cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0487db6164f74d63ae08bfc5607ee4cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0487db6164f74d63ae08bfc5607ee4cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0487db6164f74d63ae08bfc5607ee4cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:17:46.798416 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant: tempest-VolumesGetTestJSON-585415136 Aug 09 11:17:46.798416 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant-Id: 0487db6164f74d63ae08bfc5607ee4cc Aug 09 11:17:46.798416 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant-Name: tempest-VolumesGetTestJSON-585415136 Aug 09 11:17:46.798416 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User: tempest-VolumesGetTestJSON-585415136-project Aug 09 11:17:46.798416 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Domain-Id: default Aug 09 11:17:46.798416 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Domain-Name: Default Aug 09 11:17:46.798416 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Id: 1a96034d894d4fe39777baee7dcc4f95 Aug 09 11:17:46.798416 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Name: tempest-VolumesGetTestJSON-585415136-project Aug 09 11:17:46.798416 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: method: Aug 09 11:17:46.798416 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: exception: Volume dbe86013-dfcb-4322-a8af-c540deb82c1e could not be found. Aug 09 11:17:46.798416 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: action_args: {'id': 'dbe86013-dfcb-4322-a8af-c540deb82c1e'} Aug 09 11:17:46.798416 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:17:46.799278 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:17:46.799278 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 11:17:46.799278 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 11:17:46.799278 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 11:17:46.799278 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 11:17:46.799278 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 11:17:46.799278 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 11:17:46.799278 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 11:17:46.799278 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 11:17:46.799278 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 11:17:46.799278 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 11:17:46.799278 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 11:17:46.799278 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 11:17:46.799278 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 11:17:46.799278 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 11:17:46.799278 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dbe86013-dfcb-4322-a8af-c540deb82c1e could not be found. (HTTP 404) (Request-ID: req-1d8d82ca-1b6f-4594-a7ea-7158324a8167) Aug 09 11:17:46.799278 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:17:46.799278 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:17:46.799278 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:17:46.800509 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:17:46.800509 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 09 11:17:46.800509 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 09 11:17:46.800509 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 11:17:46.800509 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 11:17:46.800509 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 11:17:46.800509 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 11:17:46.800509 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 11:17:46.800509 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 11:17:46.800509 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 11:17:46.800509 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 11:17:46.800509 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 11:17:46.800509 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 11:17:46.800509 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 11:17:46.800509 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 11:17:46.800509 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 11:17:46.800509 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 11:17:46.800509 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 11:17:46.800509 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 11:17:46.801622 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 11:17:46.801622 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 11:17:46.801622 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 11:17:46.801622 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 11:17:46.801622 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dbe86013-dfcb-4322-a8af-c540deb82c1e could not be found. Aug 09 11:17:46.801622 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:17:46.801622 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:17:46.801622 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:17:46.801622 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:17:46.801622 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:17:46.801622 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:17:46.801622 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:17:46.801622 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:17:46.801622 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 11:17:46.801622 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 11:17:46.801622 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:17:46.801622 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:17:46.801622 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 09 11:17:46.801622 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:17:46.802802 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dbe86013-dfcb-4322-a8af-c540deb82c1e could not be found. Aug 09 11:17:46.802802 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:17:46.802802 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:17:46.802802 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:17:46.802802 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:17:46.802802 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:17:46.802802 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:17:46.802802 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:17:46.802802 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:17:46.802802 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dbe86013-dfcb-4322-a8af-c540deb82c1e could not be found. Aug 09 11:17:46.802802 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:17:46.805085 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-9c123d2c-a213-4602-ab86-7c3827253e6d tempest-VolumesGetTestJSON-585415136 tempest-VolumesGetTestJSON-585415136-project] Returning 404 to user: Volume dbe86013-dfcb-4322-a8af-c540deb82c1e could not be found. {{(pid=117685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:17:46.806245 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-9c123d2c-a213-4602-ab86-7c3827253e6d tempest-VolumesGetTestJSON-585415136 tempest-VolumesGetTestJSON-585415136-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/dbe86013-dfcb-4322-a8af-c540deb82c1e" status: 404 len: 109 microversion: 2.1 time: 0.336198 Aug 09 11:17:46.807922 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 3/6] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 9 11:17:46 2022] GET /compute/v2.1/os-volumes/dbe86013-dfcb-4322-a8af-c540deb82c1e => generated 109 bytes in 339 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 11:17:48.757335 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-01b002fa-d994-4c44-b2f1-853b9b31aad0 tempest-VolumesTestJSON-1622169248 tempest-VolumesTestJSON-1622169248-project] Calling method '.version_select at 0x7f2823e3faf0>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:17:48.873130 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-01b002fa-d994-4c44-b2f1-853b9b31aad0 tempest-VolumesTestJSON-1622169248 tempest-VolumesTestJSON-1622169248-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/023efd4a-1c7b-480d-999d-90a9dc8eb083" status: 200 len: 350 microversion: 2.1 time: 0.119582 Aug 09 11:17:48.873980 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 4/7] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 9 11:17:48 2022] GET /compute/v2.1/os-volumes/023efd4a-1c7b-480d-999d-90a9dc8eb083 => generated 350 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:17:50.883679 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-8110cd7d-74e0-4435-901d-eb0d3b241fa9 tempest-VolumesTestJSON-1622169248 tempest-VolumesTestJSON-1622169248-project] Calling method '.version_select at 0x7f2823e0f3a0>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:17:51.183189 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-8110cd7d-74e0-4435-901d-eb0d3b241fa9 tempest-VolumesTestJSON-1622169248 tempest-VolumesTestJSON-1622169248-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/16600816-2072-437e-90a8-b97ec344ca03" status: 200 len: 351 microversion: 2.1 time: 0.303743 Aug 09 11:17:51.184349 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 4/8] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 9 11:17:50 2022] GET /compute/v2.1/os-volumes/16600816-2072-437e-90a8-b97ec344ca03 => generated 351 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:17:51.206195 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-8bf56b8b-89d9-4b98-9c51-ae3a588b8db9 tempest-VolumesTestJSON-1622169248 tempest-VolumesTestJSON-1622169248-project] Calling method '.version_select at 0x7f2823e0fa60>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:17:51.492606 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-5e549443-69fa-49de-855a-0836ba757056 tempest-VolumesNegativeTest-108120212 tempest-VolumesNegativeTest-108120212-project] Action: 'create', calling method: .version_select at 0x7f2823ea2d30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1302276879", "metadata": {"Type": "work"}}} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:17:51.502026 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-5e549443-69fa-49de-855a-0836ba757056 tempest-VolumesNegativeTest-108120212 tempest-VolumesNegativeTest-108120212-project] Request method failure captured: Aug 09 11:17:51.502026 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 09 11:17:51.502026 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept: application/json Aug 09 11:17:51.502026 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept-Encoding: identity Aug 09 11:17:51.502026 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Connection: close Aug 09 11:17:51.502026 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Length: 122 Aug 09 11:17:51.502026 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Type: application/json Aug 09 11:17:51.502026 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Host: 10.222.0.27 Aug 09 11:17:51.502026 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Openstack-System-Scope: None Aug 09 11:17:51.502026 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: User-Agent: python-urllib3/1.26.11 Aug 09 11:17:51.502026 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Auth-Token: gAAAAABi8kJedovir_q0gHIe7kNFR2YlAgmUI2M5yUN09qSPt2Y-aIHuYXnKSjpcJUAhpQWBdeE5d4SB5xKmpfSzceDoUDUABgMfz9oZNghnM3pH8i7b7LKE0r3vvFw_zFOHHdtS3PgQ-1Y27Yer2kvHEQLK3uwSkdSf6atyWFjRzee40TQLLzU Aug 09 11:17:51.502026 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Id: None Aug 09 11:17:51.502026 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Name: None Aug 09 11:17:51.502026 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Identity-Status: Confirmed Aug 09 11:17:51.502026 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Is-Admin-Project: True Aug 09 11:17:51.502026 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Id: default Aug 09 11:17:51.502026 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Name: Default Aug 09 11:17:51.502026 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Id: 6f5cee66e85840d6bb8b4190b5562a11 Aug 09 11:17:51.502026 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Name: tempest-VolumesNegativeTest-108120212 Aug 09 11:17:51.502026 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Role: member,reader Aug 09 11:17:51.502026 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Roles: member,reader Aug 09 11:17:51.503414 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6f5cee66e85840d6bb8b4190b5562a11"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6f5cee66e85840d6bb8b4190b5562a11"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6f5cee66e85840d6bb8b4190b5562a11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6f5cee66e85840d6bb8b4190b5562a11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:17:51.503414 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant: tempest-VolumesNegativeTest-108120212 Aug 09 11:17:51.503414 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Id: 6f5cee66e85840d6bb8b4190b5562a11 Aug 09 11:17:51.503414 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Name: tempest-VolumesNegativeTest-108120212 Aug 09 11:17:51.503414 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User: tempest-VolumesNegativeTest-108120212-project Aug 09 11:17:51.503414 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Id: default Aug 09 11:17:51.503414 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Name: Default Aug 09 11:17:51.503414 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Id: 72cf0edb4c7342bda279c60280fbf4f3 Aug 09 11:17:51.503414 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Name: tempest-VolumesNegativeTest-108120212-project Aug 09 11:17:51.503414 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Aug 09 11:17:51.503414 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1302276879", "metadata": {"Type": "work"}}} Aug 09 11:17:51.503414 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: method: Aug 09 11:17:51.503414 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 09 11:17:51.504056 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1302276879', 'metadata': {'Type': 'work'}}}} Aug 09 11:17:51.504056 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:17:51.504056 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:17:51.504056 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 11:17:51.504056 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 11:17:51.504056 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 11:17:51.504056 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise error Aug 09 11:17:51.504056 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 09 11:17:51.504056 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:17:51.504056 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 09 11:17:51.504056 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 09 11:17:51.504056 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:17:51.504056 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 09 11:17:51.504056 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi '#$%' Aug 09 11:17:51.504056 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:17:51.504056 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:17:51.504056 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:17:51.504056 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:17:51.504056 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:17:51.504056 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:17:51.504056 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:17:51.504056 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:17:51.506438 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 11:17:51.506438 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 11:17:51.506438 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:17:51.506438 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:17:51.506438 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 11:17:51.506438 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 11:17:51.506438 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 11:17:51.506438 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 11:17:51.506438 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 11:17:51.506438 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 11:17:51.506438 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 09 11:17:51.506438 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:17:51.506438 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:17:51.506438 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:17:51.506438 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:17:51.506438 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:17:51.506438 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:17:51.506438 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 11:17:51.506438 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 11:17:51.507300 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 09 11:17:51.507300 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:17:51.507300 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-5e549443-69fa-49de-855a-0836ba757056 tempest-VolumesNegativeTest-108120212 tempest-VolumesNegativeTest-108120212-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:17:51.507300 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-5e549443-69fa-49de-855a-0836ba757056 tempest-VolumesNegativeTest-108120212 tempest-VolumesNegativeTest-108120212-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.321700 Aug 09 11:17:51.511167 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 5/9] 10.222.0.27 () {60 vars in 1156 bytes} [Tue Aug 9 11:17:51 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 325 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 11:17:51.520362 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-7391fd66-137a-4943-b373-5a63ed4ca565 tempest-VolumesNegativeTest-108120212 tempest-VolumesNegativeTest-108120212-project] Action: 'create', calling method: .version_select at 0x7f2823dff5e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1029295934", "metadata": {"Type": "work"}}} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:17:51.534357 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-8bf56b8b-89d9-4b98-9c51-ae3a588b8db9 tempest-VolumesTestJSON-1622169248 tempest-VolumesTestJSON-1622169248-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.341336 Aug 09 11:17:51.535211 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 5/10] 10.222.0.27 () {58 vars in 1134 bytes} [Tue Aug 9 11:17:51 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:17:51.535961 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-7391fd66-137a-4943-b373-5a63ed4ca565 tempest-VolumesNegativeTest-108120212 tempest-VolumesNegativeTest-108120212-project] Request method failure captured: Aug 09 11:17:51.535961 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 09 11:17:51.535961 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept: application/json Aug 09 11:17:51.535961 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept-Encoding: identity Aug 09 11:17:51.535961 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Connection: close Aug 09 11:17:51.535961 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Length: 120 Aug 09 11:17:51.535961 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Type: application/json Aug 09 11:17:51.535961 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Host: 10.222.0.27 Aug 09 11:17:51.535961 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Openstack-System-Scope: None Aug 09 11:17:51.535961 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: User-Agent: python-urllib3/1.26.11 Aug 09 11:17:51.535961 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Auth-Token: gAAAAABi8kJedovir_q0gHIe7kNFR2YlAgmUI2M5yUN09qSPt2Y-aIHuYXnKSjpcJUAhpQWBdeE5d4SB5xKmpfSzceDoUDUABgMfz9oZNghnM3pH8i7b7LKE0r3vvFw_zFOHHdtS3PgQ-1Y27Yer2kvHEQLK3uwSkdSf6atyWFjRzee40TQLLzU Aug 09 11:17:51.535961 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Id: None Aug 09 11:17:51.535961 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Name: None Aug 09 11:17:51.535961 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Identity-Status: Confirmed Aug 09 11:17:51.535961 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Is-Admin-Project: True Aug 09 11:17:51.535961 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Id: default Aug 09 11:17:51.535961 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Name: Default Aug 09 11:17:51.535961 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Id: 6f5cee66e85840d6bb8b4190b5562a11 Aug 09 11:17:51.535961 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Name: tempest-VolumesNegativeTest-108120212 Aug 09 11:17:51.535961 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Role: member,reader Aug 09 11:17:51.535961 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Roles: member,reader Aug 09 11:17:51.537176 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6f5cee66e85840d6bb8b4190b5562a11"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6f5cee66e85840d6bb8b4190b5562a11"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6f5cee66e85840d6bb8b4190b5562a11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6f5cee66e85840d6bb8b4190b5562a11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:17:51.537176 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant: tempest-VolumesNegativeTest-108120212 Aug 09 11:17:51.537176 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Id: 6f5cee66e85840d6bb8b4190b5562a11 Aug 09 11:17:51.537176 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Name: tempest-VolumesNegativeTest-108120212 Aug 09 11:17:51.537176 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User: tempest-VolumesNegativeTest-108120212-project Aug 09 11:17:51.537176 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Id: default Aug 09 11:17:51.537176 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Name: Default Aug 09 11:17:51.537176 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Id: 72cf0edb4c7342bda279c60280fbf4f3 Aug 09 11:17:51.537176 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Name: tempest-VolumesNegativeTest-108120212-project Aug 09 11:17:51.537176 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Aug 09 11:17:51.537176 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1029295934", "metadata": {"Type": "work"}}} Aug 09 11:17:51.537176 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: method: Aug 09 11:17:51.537176 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 09 11:17:51.537975 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1029295934', 'metadata': {'Type': 'work'}}}} Aug 09 11:17:51.537975 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:17:51.537975 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:17:51.537975 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 11:17:51.537975 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 11:17:51.537975 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 11:17:51.537975 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise error Aug 09 11:17:51.537975 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 09 11:17:51.537975 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:17:51.537975 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 09 11:17:51.537975 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 09 11:17:51.537975 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:17:51.537975 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 09 11:17:51.537975 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi '0' Aug 09 11:17:51.537975 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:17:51.537975 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:17:51.537975 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:17:51.537975 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:17:51.537975 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:17:51.537975 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:17:51.537975 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:17:51.537975 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:17:51.538957 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 11:17:51.538957 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 11:17:51.538957 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:17:51.538957 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:17:51.538957 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 11:17:51.538957 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 11:17:51.538957 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 11:17:51.538957 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 11:17:51.538957 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 11:17:51.538957 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 11:17:51.538957 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 09 11:17:51.538957 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:17:51.538957 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:17:51.538957 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:17:51.538957 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:17:51.538957 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:17:51.538957 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:17:51.538957 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 11:17:51.538957 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 11:17:51.539774 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 09 11:17:51.539774 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:17:51.539774 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-7391fd66-137a-4943-b373-5a63ed4ca565 tempest-VolumesNegativeTest-108120212 tempest-VolumesNegativeTest-108120212-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:17:51.549154 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-d60d1fd2-1b9d-4fd0-95f2-510cc20f2910 tempest-VolumesTestJSON-1622169248 tempest-VolumesTestJSON-1622169248-project] Calling method '.version_select at 0x7f2823da7160>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:17:51.553118 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-7391fd66-137a-4943-b373-5a63ed4ca565 tempest-VolumesNegativeTest-108120212 tempest-VolumesNegativeTest-108120212-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.039862 Aug 09 11:17:51.559814 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 6/11] 10.222.0.27 () {60 vars in 1156 bytes} [Tue Aug 9 11:17:51 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 11:17:51.580761 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-781970f0-feff-4ae1-bad8-ad1bd4b90909 tempest-VolumesNegativeTest-108120212 tempest-VolumesNegativeTest-108120212-project] Action: 'create', calling method: .version_select at 0x7f2823ea2ca0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-488943634", "metadata": {"Type": "work"}}} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:17:51.611699 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-781970f0-feff-4ae1-bad8-ad1bd4b90909 tempest-VolumesNegativeTest-108120212 tempest-VolumesNegativeTest-108120212-project] Request method failure captured: Aug 09 11:17:51.611699 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 09 11:17:51.611699 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept: application/json Aug 09 11:17:51.611699 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept-Encoding: identity Aug 09 11:17:51.611699 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Connection: close Aug 09 11:17:51.611699 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Length: 118 Aug 09 11:17:51.611699 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Type: application/json Aug 09 11:17:51.611699 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Host: 10.222.0.27 Aug 09 11:17:51.611699 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Openstack-System-Scope: None Aug 09 11:17:51.611699 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: User-Agent: python-urllib3/1.26.11 Aug 09 11:17:51.611699 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Auth-Token: gAAAAABi8kJedovir_q0gHIe7kNFR2YlAgmUI2M5yUN09qSPt2Y-aIHuYXnKSjpcJUAhpQWBdeE5d4SB5xKmpfSzceDoUDUABgMfz9oZNghnM3pH8i7b7LKE0r3vvFw_zFOHHdtS3PgQ-1Y27Yer2kvHEQLK3uwSkdSf6atyWFjRzee40TQLLzU Aug 09 11:17:51.611699 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Id: None Aug 09 11:17:51.611699 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Name: None Aug 09 11:17:51.611699 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Identity-Status: Confirmed Aug 09 11:17:51.611699 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Is-Admin-Project: True Aug 09 11:17:51.611699 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Id: default Aug 09 11:17:51.611699 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Name: Default Aug 09 11:17:51.611699 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Id: 6f5cee66e85840d6bb8b4190b5562a11 Aug 09 11:17:51.611699 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Name: tempest-VolumesNegativeTest-108120212 Aug 09 11:17:51.611699 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Role: member,reader Aug 09 11:17:51.611699 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Roles: member,reader Aug 09 11:17:51.613766 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6f5cee66e85840d6bb8b4190b5562a11"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6f5cee66e85840d6bb8b4190b5562a11"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6f5cee66e85840d6bb8b4190b5562a11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6f5cee66e85840d6bb8b4190b5562a11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:17:51.613766 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant: tempest-VolumesNegativeTest-108120212 Aug 09 11:17:51.613766 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Id: 6f5cee66e85840d6bb8b4190b5562a11 Aug 09 11:17:51.613766 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Name: tempest-VolumesNegativeTest-108120212 Aug 09 11:17:51.613766 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User: tempest-VolumesNegativeTest-108120212-project Aug 09 11:17:51.613766 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Id: default Aug 09 11:17:51.613766 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Name: Default Aug 09 11:17:51.613766 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Id: 72cf0edb4c7342bda279c60280fbf4f3 Aug 09 11:17:51.613766 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Name: tempest-VolumesNegativeTest-108120212-project Aug 09 11:17:51.613766 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Aug 09 11:17:51.613766 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-488943634", "metadata": {"Type": "work"}}} Aug 09 11:17:51.613766 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: method: Aug 09 11:17:51.613766 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 09 11:17:51.614378 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-488943634', 'metadata': {'Type': 'work'}}}} Aug 09 11:17:51.614378 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:17:51.614378 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:17:51.614378 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 11:17:51.614378 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 11:17:51.614378 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 11:17:51.614378 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise error Aug 09 11:17:51.614378 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 09 11:17:51.614378 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:17:51.614378 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 09 11:17:51.614378 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 09 11:17:51.614378 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:17:51.614378 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 09 11:17:51.614378 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi '' Aug 09 11:17:51.614378 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:17:51.614378 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:17:51.614378 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:17:51.614378 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:17:51.614378 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:17:51.614378 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:17:51.614378 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:17:51.614378 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:17:51.615862 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 11:17:51.615862 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 11:17:51.615862 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:17:51.615862 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:17:51.615862 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 11:17:51.615862 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 11:17:51.615862 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 11:17:51.615862 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 11:17:51.615862 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 11:17:51.615862 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 11:17:51.615862 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 09 11:17:51.615862 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:17:51.615862 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:17:51.615862 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:17:51.615862 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:17:51.615862 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:17:51.615862 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:17:51.615862 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 11:17:51.615862 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 11:17:51.616778 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 09 11:17:51.616778 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:17:51.616778 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-781970f0-feff-4ae1-bad8-ad1bd4b90909 tempest-VolumesNegativeTest-108120212 tempest-VolumesNegativeTest-108120212-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:17:51.620095 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-781970f0-feff-4ae1-bad8-ad1bd4b90909 tempest-VolumesNegativeTest-108120212 tempest-VolumesNegativeTest-108120212-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.055518 Aug 09 11:17:51.621968 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 7/12] 10.222.0.27 () {60 vars in 1156 bytes} [Tue Aug 9 11:17:51 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 11:17:51.671087 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-4187c54a-1d97-4b8a-9224-5cd47a69df9b tempest-VolumesNegativeTest-108120212 tempest-VolumesNegativeTest-108120212-project] Calling method '.version_select at 0x7f2823e065e0>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:17:51.840981 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-d60d1fd2-1b9d-4fd0-95f2-510cc20f2910 tempest-VolumesTestJSON-1622169248 tempest-VolumesTestJSON-1622169248-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.295494 Aug 09 11:17:51.841644 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 6/13] 10.222.0.27 () {58 vars in 1149 bytes} [Tue Aug 9 11:17:51 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:17:51.859066 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-fa94e821-9662-4134-95cb-3e86e8c776e5 tempest-VolumesTestJSON-1622169248 tempest-VolumesTestJSON-1622169248-project] Calling method '.version_select at 0x7f2823da7ca0>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:17:51.903100 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.wsgi [None req-4187c54a-1d97-4b8a-9224-5cd47a69df9b tempest-VolumesNegativeTest-108120212 tempest-VolumesNegativeTest-108120212-project] HTTP exception thrown: Volume tempest-invalid-86649469 could not be found. Aug 09 11:17:51.915347 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-4187c54a-1d97-4b8a-9224-5cd47a69df9b tempest-VolumesNegativeTest-108120212 tempest-VolumesNegativeTest-108120212-project] Request method failure captured: Aug 09 11:17:51.915347 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-86649469 HTTP/1.1 Aug 09 11:17:51.915347 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept: application/json Aug 09 11:17:51.915347 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept-Encoding: identity Aug 09 11:17:51.915347 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Connection: close Aug 09 11:17:51.915347 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Length: 0 Aug 09 11:17:51.915347 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Type: application/json Aug 09 11:17:51.915347 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Host: 10.222.0.27 Aug 09 11:17:51.915347 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Openstack-System-Scope: None Aug 09 11:17:51.915347 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: User-Agent: python-urllib3/1.26.11 Aug 09 11:17:51.915347 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Auth-Token: gAAAAABi8kJedovir_q0gHIe7kNFR2YlAgmUI2M5yUN09qSPt2Y-aIHuYXnKSjpcJUAhpQWBdeE5d4SB5xKmpfSzceDoUDUABgMfz9oZNghnM3pH8i7b7LKE0r3vvFw_zFOHHdtS3PgQ-1Y27Yer2kvHEQLK3uwSkdSf6atyWFjRzee40TQLLzU Aug 09 11:17:51.915347 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Id: None Aug 09 11:17:51.915347 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Name: None Aug 09 11:17:51.915347 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Identity-Status: Confirmed Aug 09 11:17:51.915347 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Is-Admin-Project: True Aug 09 11:17:51.915347 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Id: default Aug 09 11:17:51.915347 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Name: Default Aug 09 11:17:51.915347 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Id: 6f5cee66e85840d6bb8b4190b5562a11 Aug 09 11:17:51.915347 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Name: tempest-VolumesNegativeTest-108120212 Aug 09 11:17:51.915347 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Role: member,reader Aug 09 11:17:51.915347 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Roles: member,reader Aug 09 11:17:51.916671 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6f5cee66e85840d6bb8b4190b5562a11"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6f5cee66e85840d6bb8b4190b5562a11"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6f5cee66e85840d6bb8b4190b5562a11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6f5cee66e85840d6bb8b4190b5562a11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:17:51.916671 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant: tempest-VolumesNegativeTest-108120212 Aug 09 11:17:51.916671 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Id: 6f5cee66e85840d6bb8b4190b5562a11 Aug 09 11:17:51.916671 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Name: tempest-VolumesNegativeTest-108120212 Aug 09 11:17:51.916671 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User: tempest-VolumesNegativeTest-108120212-project Aug 09 11:17:51.916671 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Id: default Aug 09 11:17:51.916671 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Name: Default Aug 09 11:17:51.916671 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Id: 72cf0edb4c7342bda279c60280fbf4f3 Aug 09 11:17:51.916671 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Name: tempest-VolumesNegativeTest-108120212-project Aug 09 11:17:51.916671 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: method: Aug 09 11:17:51.916671 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: exception: Volume tempest-invalid-86649469 could not be found. Aug 09 11:17:51.916671 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: action_args: {'id': 'tempest-invalid-86649469'} Aug 09 11:17:51.916671 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:17:51.917549 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:17:51.917549 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 11:17:51.917549 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 11:17:51.917549 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 11:17:51.917549 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 11:17:51.917549 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 11:17:51.917549 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 11:17:51.917549 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 11:17:51.917549 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 11:17:51.917549 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 11:17:51.917549 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 11:17:51.917549 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 11:17:51.917549 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 11:17:51.917549 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 11:17:51.917549 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 11:17:51.917549 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-86649469 could not be found. (HTTP 404) (Request-ID: req-6e3ea988-b3c0-4d51-846a-528aacc97fea) Aug 09 11:17:51.917549 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:17:51.917549 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:17:51.917549 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:17:51.918741 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:17:51.918741 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 09 11:17:51.918741 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 09 11:17:51.918741 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 11:17:51.918741 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 11:17:51.918741 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 11:17:51.918741 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 11:17:51.918741 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 11:17:51.918741 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 11:17:51.918741 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 11:17:51.918741 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 11:17:51.918741 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 11:17:51.918741 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 11:17:51.918741 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 11:17:51.918741 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 11:17:51.918741 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 11:17:51.918741 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 11:17:51.918741 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 11:17:51.918741 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 11:17:51.919967 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 11:17:51.919967 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 11:17:51.919967 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 11:17:51.919967 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 11:17:51.919967 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-86649469 could not be found. Aug 09 11:17:51.919967 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:17:51.919967 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:17:51.919967 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:17:51.919967 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:17:51.919967 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:17:51.919967 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:17:51.919967 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:17:51.919967 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:17:51.919967 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 11:17:51.919967 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 11:17:51.919967 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:17:51.919967 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:17:51.919967 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 09 11:17:51.919967 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:17:51.919967 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-86649469 could not be found. Aug 09 11:17:51.921382 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:17:51.921382 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:17:51.921382 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:17:51.921382 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:17:51.921382 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:17:51.921382 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:17:51.921382 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:17:51.921382 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:17:51.921382 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-86649469 could not be found. Aug 09 11:17:51.921382 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:17:51.931597 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-4187c54a-1d97-4b8a-9224-5cd47a69df9b tempest-VolumesNegativeTest-108120212 tempest-VolumesNegativeTest-108120212-project] Returning 404 to user: Volume tempest-invalid-86649469 could not be found. {{(pid=117684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:17:51.933293 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-4187c54a-1d97-4b8a-9224-5cd47a69df9b tempest-VolumesNegativeTest-108120212 tempest-VolumesNegativeTest-108120212-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/tempest-invalid-86649469" status: 404 len: 97 microversion: 2.1 time: 0.293100 Aug 09 11:17:51.934053 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 8/14] 10.222.0.27 () {58 vars in 1212 bytes} [Tue Aug 9 11:17:51 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-86649469 => generated 97 bytes in 299 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 11:17:51.953092 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-04f9e4c3-aba3-44a5-8826-421a410e9a16 tempest-VolumesNegativeTest-108120212 tempest-VolumesNegativeTest-108120212-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006177 Aug 09 11:17:51.957204 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 9/15] 10.222.0.27 () {58 vars in 1140 bytes} [Tue Aug 9 11:17:51 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 09 11:17:51.973038 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-b7225b02-43ca-401c-aa67-530d9d7c30de tempest-VolumesNegativeTest-108120212 tempest-VolumesNegativeTest-108120212-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010423 Aug 09 11:17:51.977228 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 10/16] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Aug 9 11:17:51 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 09 11:17:51.989943 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-804ed23e-8e72-41b4-a404-8ca3cdbf29e6 tempest-VolumesNegativeTest-108120212 tempest-VolumesNegativeTest-108120212-project] Calling method '.version_select at 0x7f2823e069d0>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:17:52.064824 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.wsgi [None req-804ed23e-8e72-41b4-a404-8ca3cdbf29e6 tempest-VolumesNegativeTest-108120212 tempest-VolumesNegativeTest-108120212-project] HTTP exception thrown: Volume fd1bfe94-a536-41a9-bc28-ce3033f9b487 could not be found. Aug 09 11:17:52.066752 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-804ed23e-8e72-41b4-a404-8ca3cdbf29e6 tempest-VolumesNegativeTest-108120212 tempest-VolumesNegativeTest-108120212-project] Request method failure captured: Aug 09 11:17:52.066752 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: request: DELETE /compute/v2.1/os-volumes/fd1bfe94-a536-41a9-bc28-ce3033f9b487 HTTP/1.1 Aug 09 11:17:52.066752 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept: application/json Aug 09 11:17:52.066752 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept-Encoding: identity Aug 09 11:17:52.066752 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Connection: close Aug 09 11:17:52.066752 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Length: 0 Aug 09 11:17:52.066752 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Type: application/json Aug 09 11:17:52.066752 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Host: 10.222.0.27 Aug 09 11:17:52.066752 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Openstack-System-Scope: None Aug 09 11:17:52.066752 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: User-Agent: python-urllib3/1.26.11 Aug 09 11:17:52.066752 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Auth-Token: gAAAAABi8kJedovir_q0gHIe7kNFR2YlAgmUI2M5yUN09qSPt2Y-aIHuYXnKSjpcJUAhpQWBdeE5d4SB5xKmpfSzceDoUDUABgMfz9oZNghnM3pH8i7b7LKE0r3vvFw_zFOHHdtS3PgQ-1Y27Yer2kvHEQLK3uwSkdSf6atyWFjRzee40TQLLzU Aug 09 11:17:52.066752 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Id: None Aug 09 11:17:52.066752 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Name: None Aug 09 11:17:52.066752 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Identity-Status: Confirmed Aug 09 11:17:52.066752 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Is-Admin-Project: True Aug 09 11:17:52.066752 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Id: default Aug 09 11:17:52.066752 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Name: Default Aug 09 11:17:52.066752 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Id: 6f5cee66e85840d6bb8b4190b5562a11 Aug 09 11:17:52.066752 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Name: tempest-VolumesNegativeTest-108120212 Aug 09 11:17:52.066752 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Role: member,reader Aug 09 11:17:52.066752 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Roles: member,reader Aug 09 11:17:52.067822 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6f5cee66e85840d6bb8b4190b5562a11"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6f5cee66e85840d6bb8b4190b5562a11"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6f5cee66e85840d6bb8b4190b5562a11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6f5cee66e85840d6bb8b4190b5562a11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:17:52.067822 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant: tempest-VolumesNegativeTest-108120212 Aug 09 11:17:52.067822 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Id: 6f5cee66e85840d6bb8b4190b5562a11 Aug 09 11:17:52.067822 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Name: tempest-VolumesNegativeTest-108120212 Aug 09 11:17:52.067822 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User: tempest-VolumesNegativeTest-108120212-project Aug 09 11:17:52.067822 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Id: default Aug 09 11:17:52.067822 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Name: Default Aug 09 11:17:52.067822 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Id: 72cf0edb4c7342bda279c60280fbf4f3 Aug 09 11:17:52.067822 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Name: tempest-VolumesNegativeTest-108120212-project Aug 09 11:17:52.067822 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: method: Aug 09 11:17:52.067822 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: exception: Volume fd1bfe94-a536-41a9-bc28-ce3033f9b487 could not be found. Aug 09 11:17:52.067822 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: action_args: {'id': 'fd1bfe94-a536-41a9-bc28-ce3033f9b487'} Aug 09 11:17:52.067822 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:17:52.068486 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:17:52.068486 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 11:17:52.068486 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 11:17:52.068486 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 11:17:52.068486 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 11:17:52.068486 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 11:17:52.068486 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 11:17:52.068486 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 11:17:52.068486 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 11:17:52.068486 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 11:17:52.068486 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 11:17:52.068486 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 11:17:52.068486 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 11:17:52.068486 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 11:17:52.068486 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 11:17:52.068486 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fd1bfe94-a536-41a9-bc28-ce3033f9b487 could not be found. (HTTP 404) (Request-ID: req-4b51f47c-afe9-44e2-8c09-8317a5b29275) Aug 09 11:17:52.068486 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:17:52.068486 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:17:52.068486 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:17:52.069349 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:17:52.069349 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 09 11:17:52.069349 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 09 11:17:52.069349 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 11:17:52.069349 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 11:17:52.069349 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 11:17:52.069349 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 11:17:52.069349 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 11:17:52.069349 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 11:17:52.069349 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 11:17:52.069349 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 11:17:52.069349 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 11:17:52.069349 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 11:17:52.069349 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 11:17:52.069349 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 11:17:52.069349 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 11:17:52.069349 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 11:17:52.069349 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 11:17:52.069349 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 11:17:52.071110 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 11:17:52.071110 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 11:17:52.071110 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 11:17:52.071110 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 11:17:52.071110 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fd1bfe94-a536-41a9-bc28-ce3033f9b487 could not be found. Aug 09 11:17:52.071110 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:17:52.071110 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:17:52.071110 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:17:52.071110 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:17:52.071110 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:17:52.071110 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:17:52.071110 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:17:52.071110 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:17:52.071110 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 11:17:52.071110 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 11:17:52.071110 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:17:52.071110 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:17:52.071110 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 09 11:17:52.071110 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:17:52.074881 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fd1bfe94-a536-41a9-bc28-ce3033f9b487 could not be found. Aug 09 11:17:52.074881 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:17:52.074881 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:17:52.074881 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:17:52.074881 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:17:52.074881 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:17:52.074881 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:17:52.074881 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:17:52.074881 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:17:52.074881 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fd1bfe94-a536-41a9-bc28-ce3033f9b487 could not be found. Aug 09 11:17:52.074881 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:17:52.074881 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-804ed23e-8e72-41b4-a404-8ca3cdbf29e6 tempest-VolumesNegativeTest-108120212 tempest-VolumesNegativeTest-108120212-project] Returning 404 to user: Volume fd1bfe94-a536-41a9-bc28-ce3033f9b487 could not be found. {{(pid=117684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:17:52.074881 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-804ed23e-8e72-41b4-a404-8ca3cdbf29e6 tempest-VolumesNegativeTest-108120212 tempest-VolumesNegativeTest-108120212-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/fd1bfe94-a536-41a9-bc28-ce3033f9b487" status: 404 len: 109 microversion: 2.1 time: 0.082304 Aug 09 11:17:52.074881 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 11/17] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Aug 9 11:17:51 2022] DELETE /compute/v2.1/os-volumes/fd1bfe94-a536-41a9-bc28-ce3033f9b487 => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:17:52.086430 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-f9122f3f-631c-4bec-be02-b75cdd5eddad tempest-VolumesNegativeTest-108120212 tempest-VolumesNegativeTest-108120212-project] Calling method '.version_select at 0x7f2823e06d30>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:17:52.133555 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.wsgi [None req-f9122f3f-631c-4bec-be02-b75cdd5eddad tempest-VolumesNegativeTest-108120212 tempest-VolumesNegativeTest-108120212-project] HTTP exception thrown: Volume 33ab9efd-bb8a-4355-83fb-dfd1e3d2d375 could not be found. Aug 09 11:17:52.135010 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-fa94e821-9662-4134-95cb-3e86e8c776e5 tempest-VolumesTestJSON-1622169248 tempest-VolumesTestJSON-1622169248-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.283368 Aug 09 11:17:52.135502 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-f9122f3f-631c-4bec-be02-b75cdd5eddad tempest-VolumesNegativeTest-108120212 tempest-VolumesNegativeTest-108120212-project] Request method failure captured: Aug 09 11:17:52.135502 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: request: GET /compute/v2.1/os-volumes/33ab9efd-bb8a-4355-83fb-dfd1e3d2d375 HTTP/1.1 Aug 09 11:17:52.135502 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept: application/json Aug 09 11:17:52.135502 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept-Encoding: identity Aug 09 11:17:52.135502 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Connection: close Aug 09 11:17:52.135502 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Length: 0 Aug 09 11:17:52.135502 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Type: application/json Aug 09 11:17:52.135502 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Host: 10.222.0.27 Aug 09 11:17:52.135502 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Openstack-System-Scope: None Aug 09 11:17:52.135502 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: User-Agent: python-urllib3/1.26.11 Aug 09 11:17:52.135502 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Auth-Token: gAAAAABi8kJedovir_q0gHIe7kNFR2YlAgmUI2M5yUN09qSPt2Y-aIHuYXnKSjpcJUAhpQWBdeE5d4SB5xKmpfSzceDoUDUABgMfz9oZNghnM3pH8i7b7LKE0r3vvFw_zFOHHdtS3PgQ-1Y27Yer2kvHEQLK3uwSkdSf6atyWFjRzee40TQLLzU Aug 09 11:17:52.135502 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Id: None Aug 09 11:17:52.135502 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Name: None Aug 09 11:17:52.135502 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Identity-Status: Confirmed Aug 09 11:17:52.135502 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Is-Admin-Project: True Aug 09 11:17:52.135502 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Id: default Aug 09 11:17:52.135502 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Name: Default Aug 09 11:17:52.135502 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Id: 6f5cee66e85840d6bb8b4190b5562a11 Aug 09 11:17:52.135502 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Name: tempest-VolumesNegativeTest-108120212 Aug 09 11:17:52.135502 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Role: member,reader Aug 09 11:17:52.135502 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Roles: member,reader Aug 09 11:17:52.136671 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6f5cee66e85840d6bb8b4190b5562a11"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6f5cee66e85840d6bb8b4190b5562a11"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6f5cee66e85840d6bb8b4190b5562a11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6f5cee66e85840d6bb8b4190b5562a11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:17:52.136671 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant: tempest-VolumesNegativeTest-108120212 Aug 09 11:17:52.136671 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Id: 6f5cee66e85840d6bb8b4190b5562a11 Aug 09 11:17:52.136671 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Name: tempest-VolumesNegativeTest-108120212 Aug 09 11:17:52.136671 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User: tempest-VolumesNegativeTest-108120212-project Aug 09 11:17:52.136671 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Id: default Aug 09 11:17:52.136671 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Name: Default Aug 09 11:17:52.136671 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Id: 72cf0edb4c7342bda279c60280fbf4f3 Aug 09 11:17:52.136671 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Name: tempest-VolumesNegativeTest-108120212-project Aug 09 11:17:52.136671 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: method: Aug 09 11:17:52.136671 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: exception: Volume 33ab9efd-bb8a-4355-83fb-dfd1e3d2d375 could not be found. Aug 09 11:17:52.136671 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: action_args: {'id': '33ab9efd-bb8a-4355-83fb-dfd1e3d2d375'} Aug 09 11:17:52.136671 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:17:52.137427 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:17:52.137427 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 11:17:52.137427 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 11:17:52.137427 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 11:17:52.137427 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 11:17:52.137427 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 11:17:52.137427 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 11:17:52.137427 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 11:17:52.137427 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 11:17:52.137427 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 11:17:52.137427 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 11:17:52.137427 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 11:17:52.137427 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 11:17:52.137427 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 11:17:52.137427 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 11:17:52.137427 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 33ab9efd-bb8a-4355-83fb-dfd1e3d2d375 could not be found. (HTTP 404) (Request-ID: req-a46a4b72-0926-4513-ac1d-66a4f2593bd6) Aug 09 11:17:52.137427 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:17:52.137427 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:17:52.137427 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:17:52.138535 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:17:52.138535 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 09 11:17:52.138535 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 09 11:17:52.138535 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 11:17:52.138535 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 11:17:52.138535 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 11:17:52.138535 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 11:17:52.138535 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 11:17:52.138535 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 11:17:52.138535 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 11:17:52.138535 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 11:17:52.138535 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 11:17:52.138535 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 11:17:52.138535 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 11:17:52.138535 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 11:17:52.138535 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 11:17:52.138535 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 11:17:52.138535 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 11:17:52.138535 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 11:17:52.139395 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 11:17:52.139395 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 11:17:52.139395 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 11:17:52.139395 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 11:17:52.139395 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 33ab9efd-bb8a-4355-83fb-dfd1e3d2d375 could not be found. Aug 09 11:17:52.139395 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:17:52.139395 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:17:52.139395 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:17:52.139395 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:17:52.139395 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:17:52.139395 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:17:52.139395 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:17:52.139395 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:17:52.139395 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 11:17:52.139395 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 11:17:52.139395 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:17:52.139395 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:17:52.139395 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 09 11:17:52.139395 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:17:52.141541 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 33ab9efd-bb8a-4355-83fb-dfd1e3d2d375 could not be found. Aug 09 11:17:52.141541 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:17:52.141541 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:17:52.141541 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:17:52.141541 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:17:52.141541 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:17:52.141541 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:17:52.141541 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:17:52.141541 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:17:52.141541 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 33ab9efd-bb8a-4355-83fb-dfd1e3d2d375 could not be found. Aug 09 11:17:52.141541 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:17:52.141541 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-f9122f3f-631c-4bec-be02-b75cdd5eddad tempest-VolumesNegativeTest-108120212 tempest-VolumesNegativeTest-108120212-project] Returning 404 to user: Volume 33ab9efd-bb8a-4355-83fb-dfd1e3d2d375 could not be found. {{(pid=117684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:17:52.141541 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-f9122f3f-631c-4bec-be02-b75cdd5eddad tempest-VolumesNegativeTest-108120212 tempest-VolumesNegativeTest-108120212-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/33ab9efd-bb8a-4355-83fb-dfd1e3d2d375" status: 404 len: 109 microversion: 2.1 time: 0.062187 Aug 09 11:17:52.141541 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 12/18] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 9 11:17:52 2022] GET /compute/v2.1/os-volumes/33ab9efd-bb8a-4355-83fb-dfd1e3d2d375 => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:17:52.143502 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 7/19] 10.222.0.27 () {58 vars in 1134 bytes} [Tue Aug 9 11:17:51 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:17:52.159894 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-65bd77de-9957-46df-a901-fd8cac517e1a tempest-VolumesTestJSON-1622169248 tempest-VolumesTestJSON-1622169248-project] Calling method '.version_select at 0x7f2823dff9d0>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:17:52.420371 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-65bd77de-9957-46df-a901-fd8cac517e1a tempest-VolumesTestJSON-1622169248 tempest-VolumesTestJSON-1622169248-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.266353 Aug 09 11:17:52.434277 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-fc341496-d550-42a0-a179-430f04084be9 tempest-VolumesTestJSON-1622169248 tempest-VolumesTestJSON-1622169248-project] Calling method '.version_select at 0x7f2823da80d0>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:17:52.434658 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 13/20] 10.222.0.27 () {58 vars in 1167 bytes} [Tue Aug 9 11:17:52 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:17:52.587869 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-fc341496-d550-42a0-a179-430f04084be9 tempest-VolumesTestJSON-1622169248 tempest-VolumesTestJSON-1622169248-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.157319 Aug 09 11:17:52.588759 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 8/21] 10.222.0.27 () {58 vars in 1170 bytes} [Tue Aug 9 11:17:52 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:17:52.603131 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-4b7c23ff-7bd3-46e1-8694-b58be26e4427 tempest-VolumesTestJSON-1622169248 tempest-VolumesTestJSON-1622169248-project] Calling method '.version_select at 0x7f2823dffaf0>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:17:52.831980 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-4b7c23ff-7bd3-46e1-8694-b58be26e4427 tempest-VolumesTestJSON-1622169248 tempest-VolumesTestJSON-1622169248-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.233687 Aug 09 11:17:52.834440 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 14/22] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Aug 9 11:17:52 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:17:52.847378 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-6117cd20-8c5d-4ed4-aa1e-ac7bb4046a5a tempest-VolumesTestJSON-1622169248 tempest-VolumesTestJSON-1622169248-project] Calling method '.version_select at 0x7f2823db4310>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:17:53.036480 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-6117cd20-8c5d-4ed4-aa1e-ac7bb4046a5a tempest-VolumesTestJSON-1622169248 tempest-VolumesTestJSON-1622169248-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.193083 Aug 09 11:17:53.037537 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 9/23] 10.222.0.27 () {58 vars in 1188 bytes} [Tue Aug 9 11:17:52 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:17:53.053347 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-3cc982a3-0593-42d8-818f-233ccab41d4a tempest-VolumesTestJSON-1622169248 tempest-VolumesTestJSON-1622169248-project] Calling method '.version_select at 0x7f2823dd83a0>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:17:53.273201 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-3cc982a3-0593-42d8-818f-233ccab41d4a tempest-VolumesTestJSON-1622169248 tempest-VolumesTestJSON-1622169248-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.224023 Aug 09 11:17:53.273766 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 15/24] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Aug 9 11:17:53 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:17:54.481562 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-ab4ada51-2a14-4916-bef6-1e46cb9708eb tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Action: 'create', calling method: .version_select at 0x7f2823da8280>, body: {"keypair": {"name": "tempest-keypair-910005796", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7PwkSDSTCI27Sq02u4gC+KGl23BhoXiD9TBVaOqiqiWFVsPxTuLyGL206npvb6zZE51//B8a/sKc2JN26i9oSol7cHRXLkvOXk6Fb51dUqNrjo9uOB/XudI1ermB6OtQ=="}} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:17:54.579460 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.quota [None req-ab4ada51-2a14-4916-bef6-1e46cb9708eb tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Getting quotas for project 06dd1efa43b043cf84f9808305d97bf0. Resources: {'key_pairs'} {{(pid=117685) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:17:54.593059 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.quota [None req-ab4ada51-2a14-4916-bef6-1e46cb9708eb tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Getting quotas for user 601782d5743c47f380358021be28cc91 and project 06dd1efa43b043cf84f9808305d97bf0. Resources: {'key_pairs'} {{(pid=117685) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:17:54.713837 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-ab4ada51-2a14-4916-bef6-1e46cb9708eb tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.496754 Aug 09 11:17:54.715300 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 10/25] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 9 11:17:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:17:59.870301 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-dfa77052-df6f-46b4-a077-099fac53ef9b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1550309687", "imageRef": "2321e9a0-fe0f-47fd-9c4b-8868eb5a00af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f0feba9d-3263-408d-8849-6962c4d9e733"}], "security_groups": [{"name": "tempest-securitygroup--479594868"}], "key_name": "tempest-keypair-910005796", "user_data": "}} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:18:00.639252 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.network.neutron [None req-dfa77052-df6f-46b4-a077-099fac53ef9b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] validate_networks() for [('f0feba9d-3263-408d-8849-6962c4d9e733', None, None, None, None, None)] {{(pid=117684) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 11:18:01.937998 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-81fccf43-a131-4eb0-adfb-0a52750d5e05 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-175128375", "imageRef": "2321e9a0-fe0f-47fd-9c4b-8868eb5a00af", "flavorRef": "452", "networks": [{"uuid": "123ffdef-0ba8-4fd2-98e0-b4426de5f5b4"}]}} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:18:02.198894 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.network.neutron [None req-81fccf43-a131-4eb0-adfb-0a52750d5e05 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] validate_networks() for [('123ffdef-0ba8-4fd2-98e0-b4426de5f5b4', None, None, None, None, None)] {{(pid=117685) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 11:18:02.835729 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-dfa77052-df6f-46b4-a077-099fac53ef9b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Flavor limits 0:0:0 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 11:18:02.836338 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-dfa77052-df6f-46b4-a077-099fac53ef9b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Image limits 0:0:0 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 11:18:02.836648 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-dfa77052-df6f-46b4-a077-099fac53ef9b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Flavor pref 0:0:0 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 11:18:02.837108 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-dfa77052-df6f-46b4-a077-099fac53ef9b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Image pref 0:0:0 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 11:18:02.837790 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-dfa77052-df6f-46b4-a077-099fac53ef9b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 11:18:02.861683 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-dfa77052-df6f-46b4-a077-099fac53ef9b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:02.872083 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-dfa77052-df6f-46b4-a077-099fac53ef9b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:02.872832 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-dfa77052-df6f-46b4-a077-099fac53ef9b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:02.874978 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-dfa77052-df6f-46b4-a077-099fac53ef9b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:02.877235 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-dfa77052-df6f-46b4-a077-099fac53ef9b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:02.878326 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-dfa77052-df6f-46b4-a077-099fac53ef9b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:02.961155 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.quota [None req-dfa77052-df6f-46b4-a077-099fac53ef9b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Getting quotas for project 06dd1efa43b043cf84f9808305d97bf0. Resources: {'cores', 'instances', 'ram'} {{(pid=117684) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:18:02.979621 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.quota [None req-dfa77052-df6f-46b4-a077-099fac53ef9b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Getting quotas for user 601782d5743c47f380358021be28cc91 and project 06dd1efa43b043cf84f9808305d97bf0. Resources: {'cores', 'instances', 'ram'} {{(pid=117684) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:18:03.013518 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-dfa77052-df6f-46b4-a077-099fac53ef9b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Going to run 1 instances... {{(pid=117684) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 11:18:03.016690 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-dfa77052-df6f-46b4-a077-099fac53ef9b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2321e9a0-fe0f-47fd-9c4b-8868eb5a00af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117684) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 11:18:03.224404 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-dfa77052-df6f-46b4-a077-099fac53ef9b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.362204 Aug 09 11:18:03.225952 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 16/26] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 9 11:17:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 3365 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 11:18:03.750653 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-62061dfd-6171-4cfe-be73-af2364bff128 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Action: 'create', calling method: .version_select at 0x7f2823e06c10>, body: {"keypair": {"name": "tempest-keypair-1295999284", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtYK+pB74fOsh9rvDMp+wXsyNjlgpxOrJzXk8T3we36y43ZBsUn9Kmfb4ALlcu0GM6kt8B5Mu6dbGt8Do6e5WN0jJ9A1HbjStqXu2aYKCIkbx6hw3JLrlBBDiUFIkMZxg=="}} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:18:03.797131 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.quota [None req-62061dfd-6171-4cfe-be73-af2364bff128 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Getting quotas for project f938fbc477f34eedb17c9ead3084a207. Resources: {'key_pairs'} {{(pid=117684) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:18:03.806445 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.quota [None req-62061dfd-6171-4cfe-be73-af2364bff128 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Getting quotas for user 2e6543b377f14949a6919af4e4e187b7 and project f938fbc477f34eedb17c9ead3084a207. Resources: {'key_pairs'} {{(pid=117684) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:18:03.893561 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-62061dfd-6171-4cfe-be73-af2364bff128 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.666081 Aug 09 11:18:03.894980 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 17/27] 10.222.0.27 () {62 vars in 1200 bytes} [Tue Aug 9 11:18:03 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 668 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 09 11:18:04.294635 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-81fccf43-a131-4eb0-adfb-0a52750d5e05 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Flavor limits 0:0:0 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 11:18:04.295626 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-81fccf43-a131-4eb0-adfb-0a52750d5e05 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Image limits 0:0:0 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 11:18:04.296291 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-81fccf43-a131-4eb0-adfb-0a52750d5e05 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Flavor pref 0:0:0 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 11:18:04.296726 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-81fccf43-a131-4eb0-adfb-0a52750d5e05 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Image pref 0:0:0 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 11:18:04.297135 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-81fccf43-a131-4eb0-adfb-0a52750d5e05 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 11:18:04.308891 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-81fccf43-a131-4eb0-adfb-0a52750d5e05 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:04.309375 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-81fccf43-a131-4eb0-adfb-0a52750d5e05 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:04.309801 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-81fccf43-a131-4eb0-adfb-0a52750d5e05 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:04.310509 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-81fccf43-a131-4eb0-adfb-0a52750d5e05 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:04.310947 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-81fccf43-a131-4eb0-adfb-0a52750d5e05 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:04.315983 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-81fccf43-a131-4eb0-adfb-0a52750d5e05 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:04.377013 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.quota [None req-81fccf43-a131-4eb0-adfb-0a52750d5e05 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Getting quotas for project 8459b14a54824536b415b2b7336389df. Resources: {'cores', 'instances', 'ram'} {{(pid=117685) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:18:04.395386 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.quota [None req-81fccf43-a131-4eb0-adfb-0a52750d5e05 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Getting quotas for user 69c8a0130c8e42c5b4a6ffe43d15865e and project 8459b14a54824536b415b2b7336389df. Resources: {'cores', 'instances', 'ram'} {{(pid=117685) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:18:04.430385 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-81fccf43-a131-4eb0-adfb-0a52750d5e05 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Going to run 1 instances... {{(pid=117685) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 11:18:04.434438 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-81fccf43-a131-4eb0-adfb-0a52750d5e05 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] [instance: 629b5a40-87b1-42c3-91c7-5731966c0654] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2321e9a0-fe0f-47fd-9c4b-8868eb5a00af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117685) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 11:18:04.523313 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-cea76425-34e4-47c0-bb66-e7e87d3061ae tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Action: 'create', calling method: .version_select at 0x7f2829b15d30>, body: {"keypair": {"name": "tempest-keypair-404780984", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3AM7tC/zY5aAluhnj1xo80P8lTIRAIH0OlQwohbLdpJNWwSxIcrrD7R27H7wEm2yv14Yvz8wDqFmEpbHaZVS5dgx6gT0cUOAubvxs9UmyM5aqvcmVEOTWp82wUGXNa4A=="}} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:18:04.594484 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.quota [None req-cea76425-34e4-47c0-bb66-e7e87d3061ae tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Getting quotas for project cba1dd0b689b4fff847b6fd3787b143c. Resources: {'key_pairs'} {{(pid=117684) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:18:04.619897 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.quota [None req-cea76425-34e4-47c0-bb66-e7e87d3061ae tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Getting quotas for user f4da6dd860bb45d1a703a18c2512ffe4 and project cba1dd0b689b4fff847b6fd3787b143c. Resources: {'key_pairs'} {{(pid=117684) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:18:04.623170 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-81fccf43-a131-4eb0-adfb-0a52750d5e05 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.023594 Aug 09 11:18:04.624424 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 11/28] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 9 11:18:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 3025 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 11:18:04.634341 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-cd6ab8ba-6b2a-448c-a0b5-19101ac0d6a9 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:04.642154 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-cd6ab8ba-6b2a-448c-a0b5-19101ac0d6a9 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:04.693165 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-cea76425-34e4-47c0-bb66-e7e87d3061ae tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.796693 Aug 09 11:18:04.694970 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 18/29] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 9 11:18:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:18:04.711383 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-02e7fe20-46db-44ef-8dfc-c7901807c5da tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:04.712809 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-02e7fe20-46db-44ef-8dfc-c7901807c5da tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] [instance: 629b5a40-87b1-42c3-91c7-5731966c0654] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:05.008167 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-cd6ab8ba-6b2a-448c-a0b5-19101ac0d6a9 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:05.016020 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-02e7fe20-46db-44ef-8dfc-c7901807c5da tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c8a0130c8e42c5b4a6ffe43d15865e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8459b14a54824536b415b2b7336389df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:05.037985 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-02e7fe20-46db-44ef-8dfc-c7901807c5da tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] 10.222.0.27 "GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654" status: 200 len: 1214 microversion: 2.1 time: 0.341255 Aug 09 11:18:05.039841 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 19/30] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:04 2022] GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654 => generated 1214 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:05.055857 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-cd6ab8ba-6b2a-448c-a0b5-19101ac0d6a9 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1237 microversion: 2.1 time: 0.429168 Aug 09 11:18:05.057660 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 12/31] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:04 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1237 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:06.078965 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-37f79080-b3b3-4b5d-85f5-aec5878a4169 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:06.080451 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-285e2b42-2920-4649-b593-7a1c898be5cd tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:06.081074 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-285e2b42-2920-4649-b593-7a1c898be5cd tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] [instance: 629b5a40-87b1-42c3-91c7-5731966c0654] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:06.086749 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-37f79080-b3b3-4b5d-85f5-aec5878a4169 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:06.514624 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-285e2b42-2920-4649-b593-7a1c898be5cd tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c8a0130c8e42c5b4a6ffe43d15865e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8459b14a54824536b415b2b7336389df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:06.522963 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-37f79080-b3b3-4b5d-85f5-aec5878a4169 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:06.526181 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-285e2b42-2920-4649-b593-7a1c898be5cd tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] 10.222.0.27 "GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654" status: 200 len: 1214 microversion: 2.1 time: 0.469067 Aug 09 11:18:06.528573 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 20/32] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:06 2022] GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654 => generated 1214 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:06.533045 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-37f79080-b3b3-4b5d-85f5-aec5878a4169 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1237 microversion: 2.1 time: 0.458772 Aug 09 11:18:06.533588 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 13/33] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:06 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1237 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:18:07.549110 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-60912c97-4f85-442e-bf1c-76f29cbe0634 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:07.551083 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-60912c97-4f85-442e-bf1c-76f29cbe0634 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] [instance: 629b5a40-87b1-42c3-91c7-5731966c0654] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:07.562043 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-61d2d3d8-aad3-48d8-9f2d-c3d7f10f957d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:07.562647 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-61d2d3d8-aad3-48d8-9f2d-c3d7f10f957d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:07.579623 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-61d2d3d8-aad3-48d8-9f2d-c3d7f10f957d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:07.580132 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-61d2d3d8-aad3-48d8-9f2d-c3d7f10f957d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:07.580605 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-61d2d3d8-aad3-48d8-9f2d-c3d7f10f957d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:07.581324 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-61d2d3d8-aad3-48d8-9f2d-c3d7f10f957d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:07.581776 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-61d2d3d8-aad3-48d8-9f2d-c3d7f10f957d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:07.582193 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-61d2d3d8-aad3-48d8-9f2d-c3d7f10f957d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:07.585121 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-60912c97-4f85-442e-bf1c-76f29cbe0634 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:07.586459 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-60912c97-4f85-442e-bf1c-76f29cbe0634 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:07.587499 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-60912c97-4f85-442e-bf1c-76f29cbe0634 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:07.589677 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-60912c97-4f85-442e-bf1c-76f29cbe0634 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:07.594212 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-60912c97-4f85-442e-bf1c-76f29cbe0634 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:07.594669 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-60912c97-4f85-442e-bf1c-76f29cbe0634 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:08.325569 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-61d2d3d8-aad3-48d8-9f2d-c3d7f10f957d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:08.352295 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-61d2d3d8-aad3-48d8-9f2d-c3d7f10f957d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1241 microversion: 2.1 time: 0.792645 Aug 09 11:18:08.366157 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 14/34] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:07 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1241 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:18:08.926231 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-60912c97-4f85-442e-bf1c-76f29cbe0634 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c8a0130c8e42c5b4a6ffe43d15865e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8459b14a54824536b415b2b7336389df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:08.981480 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-60912c97-4f85-442e-bf1c-76f29cbe0634 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] 10.222.0.27 "GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654" status: 200 len: 1210 microversion: 2.1 time: 1.435116 Aug 09 11:18:08.982883 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 21/35] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:07 2022] GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654 => generated 1210 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:09.374066 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-3982b57c-ecaa-46ff-a293-3abbcaae1232 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:09.374723 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-3982b57c-ecaa-46ff-a293-3abbcaae1232 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:09.403546 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3982b57c-ecaa-46ff-a293-3abbcaae1232 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:09.404078 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3982b57c-ecaa-46ff-a293-3abbcaae1232 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:09.413212 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3982b57c-ecaa-46ff-a293-3abbcaae1232 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:09.414354 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3982b57c-ecaa-46ff-a293-3abbcaae1232 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:09.414838 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3982b57c-ecaa-46ff-a293-3abbcaae1232 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:09.415280 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3982b57c-ecaa-46ff-a293-3abbcaae1232 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:09.577336 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-3982b57c-ecaa-46ff-a293-3abbcaae1232 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:09.586321 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-3982b57c-ecaa-46ff-a293-3abbcaae1232 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1295 microversion: 2.1 time: 0.215804 Aug 09 11:18:09.595186 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 15/36] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:09 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1295 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:10.008359 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-e59e2164-1063-4d7f-9dc6-b722e16610a4 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:10.009643 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-e59e2164-1063-4d7f-9dc6-b722e16610a4 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] [instance: 629b5a40-87b1-42c3-91c7-5731966c0654] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:10.026652 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e59e2164-1063-4d7f-9dc6-b722e16610a4 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:10.033955 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e59e2164-1063-4d7f-9dc6-b722e16610a4 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:10.034704 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e59e2164-1063-4d7f-9dc6-b722e16610a4 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:10.038190 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e59e2164-1063-4d7f-9dc6-b722e16610a4 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:10.038913 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e59e2164-1063-4d7f-9dc6-b722e16610a4 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:10.041784 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e59e2164-1063-4d7f-9dc6-b722e16610a4 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:10.315870 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-e59e2164-1063-4d7f-9dc6-b722e16610a4 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c8a0130c8e42c5b4a6ffe43d15865e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8459b14a54824536b415b2b7336389df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:10.324639 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-e59e2164-1063-4d7f-9dc6-b722e16610a4 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] 10.222.0.27 "GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654" status: 200 len: 1272 microversion: 2.1 time: 0.320834 Aug 09 11:18:10.327091 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 22/37] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:10 2022] GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654 => generated 1272 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:10.610108 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-e7944f61-8859-4609-9fa4-46144f194338 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:10.611818 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-e7944f61-8859-4609-9fa4-46144f194338 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:10.623649 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e7944f61-8859-4609-9fa4-46144f194338 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:10.624478 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e7944f61-8859-4609-9fa4-46144f194338 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:10.633644 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e7944f61-8859-4609-9fa4-46144f194338 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:10.642164 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e7944f61-8859-4609-9fa4-46144f194338 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:10.643150 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e7944f61-8859-4609-9fa4-46144f194338 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:10.643601 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e7944f61-8859-4609-9fa4-46144f194338 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:11.257861 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-e7944f61-8859-4609-9fa4-46144f194338 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:11.283203 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-e7944f61-8859-4609-9fa4-46144f194338 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1295 microversion: 2.1 time: 0.669108 Aug 09 11:18:11.283203 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 16/38] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:10 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1295 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:11.295452 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-dca1d4b5-4e6d-4f58-8f53-972da4de08ea tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-559007015", "imageRef": "2321e9a0-fe0f-47fd-9c4b-8868eb5a00af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f4545659-27a2-43ba-a7bb-5771ac314449"}], "security_groups": [{"name": "tempest-securitygroup--628874309"}], "key_name": "tempest-keypair-1295999284", "user_data": "}} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:18:11.351546 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-473efdfc-0eec-4503-8345-235b63f28cd7 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:11.352890 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-473efdfc-0eec-4503-8345-235b63f28cd7 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] [instance: 629b5a40-87b1-42c3-91c7-5731966c0654] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:11.423982 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-473efdfc-0eec-4503-8345-235b63f28cd7 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:11.427410 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-473efdfc-0eec-4503-8345-235b63f28cd7 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:11.431254 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-473efdfc-0eec-4503-8345-235b63f28cd7 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:11.434388 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-473efdfc-0eec-4503-8345-235b63f28cd7 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:11.444876 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-473efdfc-0eec-4503-8345-235b63f28cd7 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:11.445886 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-473efdfc-0eec-4503-8345-235b63f28cd7 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:12.149331 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-473efdfc-0eec-4503-8345-235b63f28cd7 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c8a0130c8e42c5b4a6ffe43d15865e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8459b14a54824536b415b2b7336389df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:12.187745 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-473efdfc-0eec-4503-8345-235b63f28cd7 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] 10.222.0.27 "GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654" status: 200 len: 1272 microversion: 2.1 time: 0.824498 Aug 09 11:18:12.187745 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 17/39] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:11 2022] GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654 => generated 1272 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:18:12.300222 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-78072493-1124-4926-9b72-bc1aa31f820f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:12.301516 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-78072493-1124-4926-9b72-bc1aa31f820f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:12.314744 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-78072493-1124-4926-9b72-bc1aa31f820f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:12.315556 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-78072493-1124-4926-9b72-bc1aa31f820f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:12.316212 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-78072493-1124-4926-9b72-bc1aa31f820f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:12.317421 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-78072493-1124-4926-9b72-bc1aa31f820f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:12.318073 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-78072493-1124-4926-9b72-bc1aa31f820f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:12.318898 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-78072493-1124-4926-9b72-bc1aa31f820f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:12.632117 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.network.neutron [None req-dca1d4b5-4e6d-4f58-8f53-972da4de08ea tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] validate_networks() for [('f4545659-27a2-43ba-a7bb-5771ac314449', None, None, None, None, None)] {{(pid=117684) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 11:18:12.919415 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell0:SELECT=2 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:13.706780 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-78072493-1124-4926-9b72-bc1aa31f820f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:13.732460 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-78072493-1124-4926-9b72-bc1aa31f820f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1362 microversion: 2.1 time: 1.437062 Aug 09 11:18:13.761028 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 18/40] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:12 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1362 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:13.787321 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-8e59beee-67db-43f7-82ef-3f1c90a657e8 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1264637006", "imageRef": "2321e9a0-fe0f-47fd-9c4b-8868eb5a00af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9bf85ef7-1c92-4e5f-a5b9-fcad7da95bf2"}], "security_groups": [{"name": "tempest-securitygroup--1040014241"}], "key_name": "tempest-keypair-404780984", "user_data": "}} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:18:14.367245 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell0:SELECT=2 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:15.293894 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.network.neutron [None req-8e59beee-67db-43f7-82ef-3f1c90a657e8 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] validate_networks() for [('9bf85ef7-1c92-4e5f-a5b9-fcad7da95bf2', None, None, None, None, None)] {{(pid=117685) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 11:18:15.642654 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-dca1d4b5-4e6d-4f58-8f53-972da4de08ea tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Flavor limits 0:0:0 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 11:18:15.643836 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-dca1d4b5-4e6d-4f58-8f53-972da4de08ea tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Image limits 0:0:0 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 11:18:15.644867 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-dca1d4b5-4e6d-4f58-8f53-972da4de08ea tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Flavor pref 0:0:0 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 11:18:15.645536 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-dca1d4b5-4e6d-4f58-8f53-972da4de08ea tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Image pref 0:0:0 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 11:18:15.646318 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-dca1d4b5-4e6d-4f58-8f53-972da4de08ea tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 11:18:15.673985 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-dca1d4b5-4e6d-4f58-8f53-972da4de08ea tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:15.675135 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-dca1d4b5-4e6d-4f58-8f53-972da4de08ea tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:15.675758 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-dca1d4b5-4e6d-4f58-8f53-972da4de08ea tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:15.677505 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-dca1d4b5-4e6d-4f58-8f53-972da4de08ea tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:15.678446 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-dca1d4b5-4e6d-4f58-8f53-972da4de08ea tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:15.679201 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-dca1d4b5-4e6d-4f58-8f53-972da4de08ea tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:15.707579 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.quota [None req-dca1d4b5-4e6d-4f58-8f53-972da4de08ea tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Getting quotas for project f938fbc477f34eedb17c9ead3084a207. Resources: {'cores', 'instances', 'ram'} {{(pid=117684) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:18:15.713643 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.quota [None req-dca1d4b5-4e6d-4f58-8f53-972da4de08ea tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Getting quotas for user 2e6543b377f14949a6919af4e4e187b7 and project f938fbc477f34eedb17c9ead3084a207. Resources: {'cores', 'instances', 'ram'} {{(pid=117684) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:18:15.731227 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-dca1d4b5-4e6d-4f58-8f53-972da4de08ea tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Going to run 1 instances... {{(pid=117684) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 11:18:15.734144 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-dca1d4b5-4e6d-4f58-8f53-972da4de08ea tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2321e9a0-fe0f-47fd-9c4b-8868eb5a00af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117684) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 11:18:15.831642 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-dca1d4b5-4e6d-4f58-8f53-972da4de08ea tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 4.546324 Aug 09 11:18:15.833963 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 23/41] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Aug 9 11:18:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 4549 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 09 11:18:15.848067 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-6e1f891e-61ec-46be-80d3-7e674bac705a tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:15.848913 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-6e1f891e-61ec-46be-80d3-7e674bac705a tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] [instance: 629b5a40-87b1-42c3-91c7-5731966c0654] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:15.882545 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6e1f891e-61ec-46be-80d3-7e674bac705a tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:15.883341 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6e1f891e-61ec-46be-80d3-7e674bac705a tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:15.884127 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6e1f891e-61ec-46be-80d3-7e674bac705a tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:15.888463 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6e1f891e-61ec-46be-80d3-7e674bac705a tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:15.889183 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6e1f891e-61ec-46be-80d3-7e674bac705a tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:15.890455 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6e1f891e-61ec-46be-80d3-7e674bac705a tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:16.528608 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell0:SELECT=14 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:16.659518 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=4 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:17.155629 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-6e1f891e-61ec-46be-80d3-7e674bac705a tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c8a0130c8e42c5b4a6ffe43d15865e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8459b14a54824536b415b2b7336389df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:17.171331 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-6e1f891e-61ec-46be-80d3-7e674bac705a tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] 10.222.0.27 "GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654" status: 200 len: 1314 microversion: 2.1 time: 1.333038 Aug 09 11:18:17.187774 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 24/42] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:15 2022] GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654 => generated 1314 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:17.193407 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-fd535be5-6afe-442b-8a54-322c5ee4ecbe tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:17.202045 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-fd535be5-6afe-442b-8a54-322c5ee4ecbe tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:17.215868 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-fd535be5-6afe-442b-8a54-322c5ee4ecbe tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:17.223720 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-fd535be5-6afe-442b-8a54-322c5ee4ecbe tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:17.224232 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-fd535be5-6afe-442b-8a54-322c5ee4ecbe tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:17.225149 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-fd535be5-6afe-442b-8a54-322c5ee4ecbe tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:17.225563 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-fd535be5-6afe-442b-8a54-322c5ee4ecbe tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:17.226409 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-fd535be5-6afe-442b-8a54-322c5ee4ecbe tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:17.701218 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-fd535be5-6afe-442b-8a54-322c5ee4ecbe tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:17.726361 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-fd535be5-6afe-442b-8a54-322c5ee4ecbe tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1362 microversion: 2.1 time: 0.530617 Aug 09 11:18:17.729009 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 25/43] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:17 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1362 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:17.753223 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-94267328-38c2-4367-a260-8e0b637d927e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:17.756432 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-94267328-38c2-4367-a260-8e0b637d927e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:17.792473 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-94267328-38c2-4367-a260-8e0b637d927e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:17.794290 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-94267328-38c2-4367-a260-8e0b637d927e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:17.795299 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-94267328-38c2-4367-a260-8e0b637d927e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:17.800952 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-94267328-38c2-4367-a260-8e0b637d927e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:17.805802 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-94267328-38c2-4367-a260-8e0b637d927e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:17.806471 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-94267328-38c2-4367-a260-8e0b637d927e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:17.836848 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-8e59beee-67db-43f7-82ef-3f1c90a657e8 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Flavor limits 0:0:0 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 11:18:17.837696 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-8e59beee-67db-43f7-82ef-3f1c90a657e8 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Image limits 0:0:0 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 11:18:17.839177 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-8e59beee-67db-43f7-82ef-3f1c90a657e8 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Flavor pref 0:0:0 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 11:18:17.839416 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-8e59beee-67db-43f7-82ef-3f1c90a657e8 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Image pref 0:0:0 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 11:18:17.840210 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-8e59beee-67db-43f7-82ef-3f1c90a657e8 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 11:18:17.875944 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8e59beee-67db-43f7-82ef-3f1c90a657e8 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:17.881212 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8e59beee-67db-43f7-82ef-3f1c90a657e8 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:17.881880 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8e59beee-67db-43f7-82ef-3f1c90a657e8 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:17.885199 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8e59beee-67db-43f7-82ef-3f1c90a657e8 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:17.887879 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8e59beee-67db-43f7-82ef-3f1c90a657e8 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:17.888597 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8e59beee-67db-43f7-82ef-3f1c90a657e8 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:17.943119 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.quota [None req-8e59beee-67db-43f7-82ef-3f1c90a657e8 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Getting quotas for project cba1dd0b689b4fff847b6fd3787b143c. Resources: {'cores', 'instances', 'ram'} {{(pid=117685) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:18:17.955913 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.quota [None req-8e59beee-67db-43f7-82ef-3f1c90a657e8 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Getting quotas for user f4da6dd860bb45d1a703a18c2512ffe4 and project cba1dd0b689b4fff847b6fd3787b143c. Resources: {'cores', 'instances', 'ram'} {{(pid=117685) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:18:18.001651 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-8e59beee-67db-43f7-82ef-3f1c90a657e8 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Going to run 1 instances... {{(pid=117685) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 11:18:18.011223 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-8e59beee-67db-43f7-82ef-3f1c90a657e8 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 1329e8e9-9358-454d-bea3-dad19dfc53da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2321e9a0-fe0f-47fd-9c4b-8868eb5a00af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117685) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 11:18:18.083927 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-8e59beee-67db-43f7-82ef-3f1c90a657e8 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.315808 Aug 09 11:18:18.085516 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 19/44] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 9 11:18:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 4321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 11:18:18.137062 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-94267328-38c2-4367-a260-8e0b637d927e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:18.158117 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-94267328-38c2-4367-a260-8e0b637d927e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:18.162146 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-94267328-38c2-4367-a260-8e0b637d927e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:18.171044 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-94267328-38c2-4367-a260-8e0b637d927e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1277 microversion: 2.20 time: 0.434710 Aug 09 11:18:18.174601 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 26/45] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:18:17 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1277 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:18:18.191941 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-362f9d7f-45da-4816-a5c9-3aad572bff50 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:18.207455 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-362f9d7f-45da-4816-a5c9-3aad572bff50 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 1329e8e9-9358-454d-bea3-dad19dfc53da] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:18.489971 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-362f9d7f-45da-4816-a5c9-3aad572bff50 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:18.505522 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-362f9d7f-45da-4816-a5c9-3aad572bff50 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da" status: 200 len: 1241 microversion: 2.1 time: 0.324400 Aug 09 11:18:18.507678 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 27/46] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:18 2022] GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da => generated 1241 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:18.523770 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-cbebd270-9848-42fd-a96e-07b049675ef9 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:18.527103 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-cbebd270-9848-42fd-a96e-07b049675ef9 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] [instance: 629b5a40-87b1-42c3-91c7-5731966c0654] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:18.552601 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cbebd270-9848-42fd-a96e-07b049675ef9 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:18.553109 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cbebd270-9848-42fd-a96e-07b049675ef9 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:18.553628 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cbebd270-9848-42fd-a96e-07b049675ef9 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:18.554384 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cbebd270-9848-42fd-a96e-07b049675ef9 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:18.554836 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cbebd270-9848-42fd-a96e-07b049675ef9 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:18.565976 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cbebd270-9848-42fd-a96e-07b049675ef9 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:18.672669 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-96d69c0a-3a0d-4714-a7a2-a3fb25fb0b41 req-2c5869db-aa5c-456f-bd76-3871bad1696e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb805071-5bf8-4c52-9f89-b4bb1272121f", "tag": "9c7f1d85-6e6c-4baa-88fa-0db4c9faf571"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:18:18.715870 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-96d69c0a-3a0d-4714-a7a2-a3fb25fb0b41 req-2c5869db-aa5c-456f-bd76-3871bad1696e service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:18.726123 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-96d69c0a-3a0d-4714-a7a2-a3fb25fb0b41 req-2c5869db-aa5c-456f-bd76-3871bad1696e service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:18.729834 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-96d69c0a-3a0d-4714-a7a2-a3fb25fb0b41 req-2c5869db-aa5c-456f-bd76-3871bad1696e service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:18.839376 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-96d69c0a-3a0d-4714-a7a2-a3fb25fb0b41 req-2c5869db-aa5c-456f-bd76-3871bad1696e service nova] Creating event network-changed:9c7f1d85-6e6c-4baa-88fa-0db4c9faf571 for instance fb805071-5bf8-4c52-9f89-b4bb1272121f on hv-cinder-85251 Aug 09 11:18:18.840166 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-96d69c0a-3a0d-4714-a7a2-a3fb25fb0b41 req-2c5869db-aa5c-456f-bd76-3871bad1696e service nova] Acquiring lock "compute-rpcapi-router" {{(pid=117685) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 09 11:18:18.840260 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-96d69c0a-3a0d-4714-a7a2-a3fb25fb0b41 req-2c5869db-aa5c-456f-bd76-3871bad1696e service nova] Acquired lock "compute-rpcapi-router" {{(pid=117685) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 09 11:18:18.841345 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9757b1bf-f33c-4810-a654-db81c6fc7d44 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:18.857478 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9757b1bf-f33c-4810-a654-db81c6fc7d44 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:18.859660 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9757b1bf-f33c-4810-a654-db81c6fc7d44 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:18.862787 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9757b1bf-f33c-4810-a654-db81c6fc7d44 None None] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:18.863699 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9757b1bf-f33c-4810-a654-db81c6fc7d44 None None] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:18.865389 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9757b1bf-f33c-4810-a654-db81c6fc7d44 None None] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:18.902757 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.compute.rpcapi [None req-9757b1bf-f33c-4810-a654-db81c6fc7d44 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 09 11:18:18.904500 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9757b1bf-f33c-4810-a654-db81c6fc7d44 None None] Releasing lock "compute-rpcapi-router" {{(pid=117685) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 09 11:18:18.980066 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-9757b1bf-f33c-4810-a654-db81c6fc7d44 None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.891492 Aug 09 11:18:18.981963 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 20/47] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:18:19.004843 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-59297f2d-8d6d-403e-9dad-5842e348cb50 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:19.007547 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-59297f2d-8d6d-403e-9dad-5842e348cb50 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:19.038483 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-59297f2d-8d6d-403e-9dad-5842e348cb50 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:19.047447 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-59297f2d-8d6d-403e-9dad-5842e348cb50 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:19.048606 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-59297f2d-8d6d-403e-9dad-5842e348cb50 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:19.055968 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-59297f2d-8d6d-403e-9dad-5842e348cb50 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:19.057446 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-59297f2d-8d6d-403e-9dad-5842e348cb50 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:19.058310 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-59297f2d-8d6d-403e-9dad-5842e348cb50 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:19.812293 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-cbebd270-9848-42fd-a96e-07b049675ef9 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c8a0130c8e42c5b4a6ffe43d15865e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8459b14a54824536b415b2b7336389df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:19.827188 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-cbebd270-9848-42fd-a96e-07b049675ef9 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] 10.222.0.27 "GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654" status: 200 len: 1314 microversion: 2.1 time: 1.318341 Aug 09 11:18:19.829565 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 28/48] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:18 2022] GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654 => generated 1314 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:20.258831 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-59297f2d-8d6d-403e-9dad-5842e348cb50 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:20.269574 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-59297f2d-8d6d-403e-9dad-5842e348cb50 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1362 microversion: 2.1 time: 1.284638 Aug 09 11:18:20.270368 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 21/49] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:18 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1362 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:20.307430 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-b3d1cdfb-3ccb-43f4-b684-64189a96099d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:20.307430 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-b3d1cdfb-3ccb-43f4-b684-64189a96099d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:20.307430 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b3d1cdfb-3ccb-43f4-b684-64189a96099d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:20.307430 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b3d1cdfb-3ccb-43f4-b684-64189a96099d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:20.307762 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b3d1cdfb-3ccb-43f4-b684-64189a96099d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:20.307762 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b3d1cdfb-3ccb-43f4-b684-64189a96099d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:20.307762 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b3d1cdfb-3ccb-43f4-b684-64189a96099d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:20.307762 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b3d1cdfb-3ccb-43f4-b684-64189a96099d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:20.494550 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [req-c2152c5a-430b-4624-a0ae-70913ce4e149 req-eeebdb4b-30d1-4d8c-9b93-4a00c8b1d82b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "629b5a40-87b1-42c3-91c7-5731966c0654", "tag": "2af6391a-f3a9-41ef-8789-72d123f8468e"}]} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:18:20.534651 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-c2152c5a-430b-4624-a0ae-70913ce4e149 req-eeebdb4b-30d1-4d8c-9b93-4a00c8b1d82b service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:20.535450 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-c2152c5a-430b-4624-a0ae-70913ce4e149 req-eeebdb4b-30d1-4d8c-9b93-4a00c8b1d82b service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:20.536100 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-c2152c5a-430b-4624-a0ae-70913ce4e149 req-eeebdb4b-30d1-4d8c-9b93-4a00c8b1d82b service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:20.563430 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-b3d1cdfb-3ccb-43f4-b684-64189a96099d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:20.578667 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-b3d1cdfb-3ccb-43f4-b684-64189a96099d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:20.589457 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-b3d1cdfb-3ccb-43f4-b684-64189a96099d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:20.591562 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-b3d1cdfb-3ccb-43f4-b684-64189a96099d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1339 microversion: 2.20 time: 0.316646 Aug 09 11:18:20.594527 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 22/50] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:18:20 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1339 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:18:20.599577 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-2db422da-296b-483f-b898-01afa66a801f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:20.602870 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.compute.server_external_events [req-c2152c5a-430b-4624-a0ae-70913ce4e149 req-eeebdb4b-30d1-4d8c-9b93-4a00c8b1d82b service nova] Creating event network-changed:2af6391a-f3a9-41ef-8789-72d123f8468e for instance 629b5a40-87b1-42c3-91c7-5731966c0654 on hv-cinder-85251 Aug 09 11:18:20.604843 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-2db422da-296b-483f-b898-01afa66a801f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 1329e8e9-9358-454d-bea3-dad19dfc53da] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:20.608240 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-c2152c5a-430b-4624-a0ae-70913ce4e149 req-eeebdb4b-30d1-4d8c-9b93-4a00c8b1d82b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=117684) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 09 11:18:20.613651 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-c2152c5a-430b-4624-a0ae-70913ce4e149 req-eeebdb4b-30d1-4d8c-9b93-4a00c8b1d82b service nova] Acquired lock "compute-rpcapi-router" {{(pid=117684) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 09 11:18:20.617395 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-443f29d4-b388-4bc7-b1b1-1d677126596c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:20.620111 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-443f29d4-b388-4bc7-b1b1-1d677126596c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:20.621212 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-443f29d4-b388-4bc7-b1b1-1d677126596c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:20.623242 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-443f29d4-b388-4bc7-b1b1-1d677126596c None None] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:20.625323 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-443f29d4-b388-4bc7-b1b1-1d677126596c None None] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:20.626036 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-443f29d4-b388-4bc7-b1b1-1d677126596c None None] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:20.635071 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2db422da-296b-483f-b898-01afa66a801f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:20.635572 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2db422da-296b-483f-b898-01afa66a801f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:20.636009 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2db422da-296b-483f-b898-01afa66a801f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:20.637098 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2db422da-296b-483f-b898-01afa66a801f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:20.643434 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2db422da-296b-483f-b898-01afa66a801f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:20.644448 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2db422da-296b-483f-b898-01afa66a801f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:20.654276 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.compute.rpcapi [None req-443f29d4-b388-4bc7-b1b1-1d677126596c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 09 11:18:20.656702 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-443f29d4-b388-4bc7-b1b1-1d677126596c None None] Releasing lock "compute-rpcapi-router" {{(pid=117684) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 09 11:18:20.695886 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-443f29d4-b388-4bc7-b1b1-1d677126596c None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.858617 Aug 09 11:18:20.696900 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 29/51] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:18:20.851197 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-181e2e45-d058-47ba-abcf-cdac25f93ab8 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:20.852652 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-181e2e45-d058-47ba-abcf-cdac25f93ab8 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] [instance: 629b5a40-87b1-42c3-91c7-5731966c0654] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:20.906717 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-2db422da-296b-483f-b898-01afa66a801f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:20.917945 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-181e2e45-d058-47ba-abcf-cdac25f93ab8 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:20.922193 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-181e2e45-d058-47ba-abcf-cdac25f93ab8 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:20.930674 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-2db422da-296b-483f-b898-01afa66a801f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da" status: 200 len: 1293 microversion: 2.1 time: 0.332713 Aug 09 11:18:20.931527 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 23/52] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:20 2022] GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da => generated 1293 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:20.933134 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-181e2e45-d058-47ba-abcf-cdac25f93ab8 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:20.935244 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-181e2e45-d058-47ba-abcf-cdac25f93ab8 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:20.936939 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-181e2e45-d058-47ba-abcf-cdac25f93ab8 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:20.940913 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-181e2e45-d058-47ba-abcf-cdac25f93ab8 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:21.292229 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-69e10a57-fa85-4c5e-aa5f-2cb2771ed5a0 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:21.294643 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-69e10a57-fa85-4c5e-aa5f-2cb2771ed5a0 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:21.315822 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-69e10a57-fa85-4c5e-aa5f-2cb2771ed5a0 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:21.318011 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-69e10a57-fa85-4c5e-aa5f-2cb2771ed5a0 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:21.318745 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-69e10a57-fa85-4c5e-aa5f-2cb2771ed5a0 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:21.319505 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-69e10a57-fa85-4c5e-aa5f-2cb2771ed5a0 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:21.324850 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-69e10a57-fa85-4c5e-aa5f-2cb2771ed5a0 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:21.325419 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-69e10a57-fa85-4c5e-aa5f-2cb2771ed5a0 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:21.517180 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-181e2e45-d058-47ba-abcf-cdac25f93ab8 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c8a0130c8e42c5b4a6ffe43d15865e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8459b14a54824536b415b2b7336389df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:21.535619 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-181e2e45-d058-47ba-abcf-cdac25f93ab8 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] 10.222.0.27 "GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654" status: 200 len: 1314 microversion: 2.1 time: 0.688790 Aug 09 11:18:21.552002 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 30/53] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:20 2022] GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654 => generated 1314 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:18:21.620357 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-a2908e2f-e786-42ca-a62b-2002aa902021 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:21.621371 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-a2908e2f-e786-42ca-a62b-2002aa902021 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:21.651075 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a2908e2f-e786-42ca-a62b-2002aa902021 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:21.652097 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a2908e2f-e786-42ca-a62b-2002aa902021 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:21.652837 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a2908e2f-e786-42ca-a62b-2002aa902021 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:21.653840 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a2908e2f-e786-42ca-a62b-2002aa902021 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:21.655997 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a2908e2f-e786-42ca-a62b-2002aa902021 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:21.656687 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a2908e2f-e786-42ca-a62b-2002aa902021 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:22.314072 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-a2908e2f-e786-42ca-a62b-2002aa902021 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:22.323148 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-a2908e2f-e786-42ca-a62b-2002aa902021 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:22.325443 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-a2908e2f-e786-42ca-a62b-2002aa902021 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:22.326735 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-a2908e2f-e786-42ca-a62b-2002aa902021 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1406 microversion: 2.20 time: 0.711700 Aug 09 11:18:22.332722 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 31/54] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:18:21 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1406 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 11:18:22.346996 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-8dda96f1-2c1b-459e-873f-18d4a7c05cb2 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:22.348410 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-8dda96f1-2c1b-459e-873f-18d4a7c05cb2 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 1329e8e9-9358-454d-bea3-dad19dfc53da] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:22.355061 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=8 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:22.357932 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8dda96f1-2c1b-459e-873f-18d4a7c05cb2 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:22.364017 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8dda96f1-2c1b-459e-873f-18d4a7c05cb2 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:22.364017 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8dda96f1-2c1b-459e-873f-18d4a7c05cb2 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:22.369459 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8dda96f1-2c1b-459e-873f-18d4a7c05cb2 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:22.370205 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8dda96f1-2c1b-459e-873f-18d4a7c05cb2 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:22.370806 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8dda96f1-2c1b-459e-873f-18d4a7c05cb2 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:22.477718 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-69e10a57-fa85-4c5e-aa5f-2cb2771ed5a0 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:22.492736 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-69e10a57-fa85-4c5e-aa5f-2cb2771ed5a0 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1362 microversion: 2.1 time: 1.205674 Aug 09 11:18:22.494038 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 24/55] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:21 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1362 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:22.560245 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-61ae779c-f2fe-4758-9a5d-fc85a559181b tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:22.561122 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-61ae779c-f2fe-4758-9a5d-fc85a559181b tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] [instance: 629b5a40-87b1-42c3-91c7-5731966c0654] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:22.571769 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-61ae779c-f2fe-4758-9a5d-fc85a559181b tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:22.574535 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-61ae779c-f2fe-4758-9a5d-fc85a559181b tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:22.576560 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-61ae779c-f2fe-4758-9a5d-fc85a559181b tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:22.577523 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-61ae779c-f2fe-4758-9a5d-fc85a559181b tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:22.581024 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-61ae779c-f2fe-4758-9a5d-fc85a559181b tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:22.581750 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-61ae779c-f2fe-4758-9a5d-fc85a559181b tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:22.685242 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-8dda96f1-2c1b-459e-873f-18d4a7c05cb2 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:22.694191 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-8dda96f1-2c1b-459e-873f-18d4a7c05cb2 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da" status: 200 len: 1299 microversion: 2.1 time: 0.360037 Aug 09 11:18:22.698008 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 32/56] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:22 2022] GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da => generated 1299 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:23.361100 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-18b61733-4e5a-4b9c-81cf-c48df8e23375 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:23.362233 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-18b61733-4e5a-4b9c-81cf-c48df8e23375 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:23.387542 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-18b61733-4e5a-4b9c-81cf-c48df8e23375 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:23.391176 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-18b61733-4e5a-4b9c-81cf-c48df8e23375 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:23.393427 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-18b61733-4e5a-4b9c-81cf-c48df8e23375 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:23.399590 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-18b61733-4e5a-4b9c-81cf-c48df8e23375 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:23.403843 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-18b61733-4e5a-4b9c-81cf-c48df8e23375 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:23.404488 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-18b61733-4e5a-4b9c-81cf-c48df8e23375 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:23.670303 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-61ae779c-f2fe-4758-9a5d-fc85a559181b tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c8a0130c8e42c5b4a6ffe43d15865e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8459b14a54824536b415b2b7336389df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:23.705170 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-61ae779c-f2fe-4758-9a5d-fc85a559181b tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] 10.222.0.27 "GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654" status: 200 len: 1314 microversion: 2.1 time: 1.145317 Aug 09 11:18:23.746794 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 25/57] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:22 2022] GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654 => generated 1314 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:18:23.764064 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-96c5fab1-e6f6-4ca1-ae7c-d4e297d0ba8e tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:23.764958 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-96c5fab1-e6f6-4ca1-ae7c-d4e297d0ba8e tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:23.772977 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-96c5fab1-e6f6-4ca1-ae7c-d4e297d0ba8e tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:23.774099 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-96c5fab1-e6f6-4ca1-ae7c-d4e297d0ba8e tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:23.774756 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-96c5fab1-e6f6-4ca1-ae7c-d4e297d0ba8e tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:23.775728 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-96c5fab1-e6f6-4ca1-ae7c-d4e297d0ba8e tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:23.776422 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-96c5fab1-e6f6-4ca1-ae7c-d4e297d0ba8e tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:23.777068 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-96c5fab1-e6f6-4ca1-ae7c-d4e297d0ba8e tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:24.178432 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-18b61733-4e5a-4b9c-81cf-c48df8e23375 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:24.193343 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-18b61733-4e5a-4b9c-81cf-c48df8e23375 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:24.197770 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-18b61733-4e5a-4b9c-81cf-c48df8e23375 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:24.209376 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-18b61733-4e5a-4b9c-81cf-c48df8e23375 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1406 microversion: 2.20 time: 0.854563 Aug 09 11:18:24.210695 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 33/58] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:18:23 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1406 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:18:24.216930 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-faf1138c-4725-4e68-8103-b79227f4f09d tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:24.218331 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-faf1138c-4725-4e68-8103-b79227f4f09d tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 1329e8e9-9358-454d-bea3-dad19dfc53da] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:24.225265 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-faf1138c-4725-4e68-8103-b79227f4f09d tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:24.226993 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-faf1138c-4725-4e68-8103-b79227f4f09d tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:24.227672 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-faf1138c-4725-4e68-8103-b79227f4f09d tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:24.228602 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-faf1138c-4725-4e68-8103-b79227f4f09d tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:24.229191 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-faf1138c-4725-4e68-8103-b79227f4f09d tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:24.229871 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-faf1138c-4725-4e68-8103-b79227f4f09d tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:24.381405 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-faf1138c-4725-4e68-8103-b79227f4f09d tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:24.385136 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-96c5fab1-e6f6-4ca1-ae7c-d4e297d0ba8e tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:24.391911 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-faf1138c-4725-4e68-8103-b79227f4f09d tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da" status: 200 len: 1299 microversion: 2.1 time: 0.179018 Aug 09 11:18:24.392683 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-96c5fab1-e6f6-4ca1-ae7c-d4e297d0ba8e tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1362 microversion: 2.1 time: 0.644445 Aug 09 11:18:24.393429 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 34/59] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:24 2022] GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da => generated 1299 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:24.397196 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 26/60] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:23 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1362 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:24.408169 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [req-c8232b7b-f4cb-464a-ac08-06b899e480ca req-cb08b4ca-f7ab-4d3a-93d2-78a2d44aa38a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69542c8c-90b6-49a4-aed3-c229168f215f", "tag": "e9e1072a-3971-440e-9a60-ba15e5db60f3"}]} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:18:24.429395 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-c8232b7b-f4cb-464a-ac08-06b899e480ca req-cb08b4ca-f7ab-4d3a-93d2-78a2d44aa38a service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:24.429943 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-c8232b7b-f4cb-464a-ac08-06b899e480ca req-cb08b4ca-f7ab-4d3a-93d2-78a2d44aa38a service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:24.430373 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-c8232b7b-f4cb-464a-ac08-06b899e480ca req-cb08b4ca-f7ab-4d3a-93d2-78a2d44aa38a service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:24.483165 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.compute.server_external_events [req-c8232b7b-f4cb-464a-ac08-06b899e480ca req-cb08b4ca-f7ab-4d3a-93d2-78a2d44aa38a service nova] Creating event network-changed:e9e1072a-3971-440e-9a60-ba15e5db60f3 for instance 69542c8c-90b6-49a4-aed3-c229168f215f on hv-cinder-85251 Aug 09 11:18:24.496510 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [req-c8232b7b-f4cb-464a-ac08-06b899e480ca req-cb08b4ca-f7ab-4d3a-93d2-78a2d44aa38a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101548 Aug 09 11:18:24.498581 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 35/61] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:18:24.753698 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-920941a2-6ffb-4ad1-adb9-d533897ece9d tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:24.755044 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-920941a2-6ffb-4ad1-adb9-d533897ece9d tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] [instance: 629b5a40-87b1-42c3-91c7-5731966c0654] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:24.762528 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-920941a2-6ffb-4ad1-adb9-d533897ece9d tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:24.763225 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-920941a2-6ffb-4ad1-adb9-d533897ece9d tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:24.763754 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-920941a2-6ffb-4ad1-adb9-d533897ece9d tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:24.764579 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-920941a2-6ffb-4ad1-adb9-d533897ece9d tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:24.765128 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-920941a2-6ffb-4ad1-adb9-d533897ece9d tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:24.765636 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-920941a2-6ffb-4ad1-adb9-d533897ece9d tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:24.966585 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-920941a2-6ffb-4ad1-adb9-d533897ece9d tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c8a0130c8e42c5b4a6ffe43d15865e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8459b14a54824536b415b2b7336389df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:24.975253 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-920941a2-6ffb-4ad1-adb9-d533897ece9d tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] 10.222.0.27 "GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654" status: 200 len: 1314 microversion: 2.1 time: 0.225536 Aug 09 11:18:24.987444 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 27/62] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:24 2022] GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:25.238512 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-14921e88-72d7-48a2-99b8-c52d04be41db tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:25.240827 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-14921e88-72d7-48a2-99b8-c52d04be41db tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:25.256298 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-14921e88-72d7-48a2-99b8-c52d04be41db tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:25.257211 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-14921e88-72d7-48a2-99b8-c52d04be41db tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:25.260147 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-14921e88-72d7-48a2-99b8-c52d04be41db tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:25.262747 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-14921e88-72d7-48a2-99b8-c52d04be41db tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:25.263243 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-14921e88-72d7-48a2-99b8-c52d04be41db tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:25.263677 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-14921e88-72d7-48a2-99b8-c52d04be41db tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:25.416107 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-fefb4717-ef08-4924-8153-b830cc8eb42a tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:25.416811 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-fefb4717-ef08-4924-8153-b830cc8eb42a tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:25.427318 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fefb4717-ef08-4924-8153-b830cc8eb42a tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:25.427814 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fefb4717-ef08-4924-8153-b830cc8eb42a tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:25.428247 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fefb4717-ef08-4924-8153-b830cc8eb42a tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:25.428974 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fefb4717-ef08-4924-8153-b830cc8eb42a tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:25.429450 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fefb4717-ef08-4924-8153-b830cc8eb42a tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:25.429955 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fefb4717-ef08-4924-8153-b830cc8eb42a tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:25.561173 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-14921e88-72d7-48a2-99b8-c52d04be41db tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:25.573433 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-14921e88-72d7-48a2-99b8-c52d04be41db tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:25.575756 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-14921e88-72d7-48a2-99b8-c52d04be41db tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:25.577475 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-14921e88-72d7-48a2-99b8-c52d04be41db tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1406 microversion: 2.20 time: 0.345369 Aug 09 11:18:25.580896 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 36/63] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:18:25 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1406 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:18:25.587092 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-99f68b6e-a997-4da0-95f6-0ff99c1e0659 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:25.587783 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-99f68b6e-a997-4da0-95f6-0ff99c1e0659 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 1329e8e9-9358-454d-bea3-dad19dfc53da] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:25.594573 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-99f68b6e-a997-4da0-95f6-0ff99c1e0659 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:25.595199 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-99f68b6e-a997-4da0-95f6-0ff99c1e0659 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:25.595696 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-99f68b6e-a997-4da0-95f6-0ff99c1e0659 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:25.596667 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-99f68b6e-a997-4da0-95f6-0ff99c1e0659 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:25.597338 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-99f68b6e-a997-4da0-95f6-0ff99c1e0659 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:25.597960 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-99f68b6e-a997-4da0-95f6-0ff99c1e0659 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:25.668795 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-fefb4717-ef08-4924-8153-b830cc8eb42a tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:25.676438 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-fefb4717-ef08-4924-8153-b830cc8eb42a tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1362 microversion: 2.1 time: 0.266281 Aug 09 11:18:25.681132 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 28/64] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:25 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1362 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:25.875916 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-99f68b6e-a997-4da0-95f6-0ff99c1e0659 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:25.887664 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-99f68b6e-a997-4da0-95f6-0ff99c1e0659 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da" status: 200 len: 1367 microversion: 2.1 time: 0.305036 Aug 09 11:18:25.888715 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 37/65] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:25 2022] GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da => generated 1367 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:25.996763 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-2dd1716d-b599-4176-8691-f2d31fef50f2 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:25.997450 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-2dd1716d-b599-4176-8691-f2d31fef50f2 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] [instance: 629b5a40-87b1-42c3-91c7-5731966c0654] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:26.015664 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2dd1716d-b599-4176-8691-f2d31fef50f2 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:26.016156 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2dd1716d-b599-4176-8691-f2d31fef50f2 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:26.016985 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2dd1716d-b599-4176-8691-f2d31fef50f2 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:26.017701 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2dd1716d-b599-4176-8691-f2d31fef50f2 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:26.018149 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2dd1716d-b599-4176-8691-f2d31fef50f2 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:26.018565 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2dd1716d-b599-4176-8691-f2d31fef50f2 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:26.583095 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-2dd1716d-b599-4176-8691-f2d31fef50f2 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c8a0130c8e42c5b4a6ffe43d15865e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8459b14a54824536b415b2b7336389df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:26.591875 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-2dd1716d-b599-4176-8691-f2d31fef50f2 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] 10.222.0.27 "GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654" status: 200 len: 1314 microversion: 2.1 time: 0.600126 Aug 09 11:18:26.593246 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 29/66] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:25 2022] GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654 => generated 1314 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:26.618710 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-2c2a7341-bc6c-46c1-a527-418028292666 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:26.619929 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-2c2a7341-bc6c-46c1-a527-418028292666 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:26.626626 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2c2a7341-bc6c-46c1-a527-418028292666 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:26.627203 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2c2a7341-bc6c-46c1-a527-418028292666 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:26.627856 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2c2a7341-bc6c-46c1-a527-418028292666 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:26.628589 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2c2a7341-bc6c-46c1-a527-418028292666 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:26.629280 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2c2a7341-bc6c-46c1-a527-418028292666 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:26.629874 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2c2a7341-bc6c-46c1-a527-418028292666 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:26.707668 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-1ddf8cb0-6531-4cd1-989b-0e7662da349f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:26.708324 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-1ddf8cb0-6531-4cd1-989b-0e7662da349f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:26.717556 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1ddf8cb0-6531-4cd1-989b-0e7662da349f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:26.718074 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1ddf8cb0-6531-4cd1-989b-0e7662da349f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:26.718537 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1ddf8cb0-6531-4cd1-989b-0e7662da349f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:26.719277 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1ddf8cb0-6531-4cd1-989b-0e7662da349f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:26.719770 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1ddf8cb0-6531-4cd1-989b-0e7662da349f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:26.720194 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1ddf8cb0-6531-4cd1-989b-0e7662da349f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:27.060375 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-2c2a7341-bc6c-46c1-a527-418028292666 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:27.068788 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-2c2a7341-bc6c-46c1-a527-418028292666 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:27.070330 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-2c2a7341-bc6c-46c1-a527-418028292666 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:27.072232 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-2c2a7341-bc6c-46c1-a527-418028292666 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1406 microversion: 2.20 time: 0.459602 Aug 09 11:18:27.076299 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 38/67] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:18:26 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1406 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:18:27.081997 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-27630f24-06b5-4a86-bf42-055e1a15430d tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:27.102659 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-27630f24-06b5-4a86-bf42-055e1a15430d tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 1329e8e9-9358-454d-bea3-dad19dfc53da] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:27.102837 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-1ddf8cb0-6531-4cd1-989b-0e7662da349f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:27.121756 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-1ddf8cb0-6531-4cd1-989b-0e7662da349f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1362 microversion: 2.1 time: 0.419363 Aug 09 11:18:27.127320 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 30/68] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:26 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1362 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:27.145171 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-27630f24-06b5-4a86-bf42-055e1a15430d tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:27.145657 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-27630f24-06b5-4a86-bf42-055e1a15430d tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:27.146090 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-27630f24-06b5-4a86-bf42-055e1a15430d tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:27.146793 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-27630f24-06b5-4a86-bf42-055e1a15430d tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:27.147236 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-27630f24-06b5-4a86-bf42-055e1a15430d tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:27.147651 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-27630f24-06b5-4a86-bf42-055e1a15430d tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:27.621718 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-328efc10-7164-4d8f-9843-efc57d535028 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:27.623029 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-328efc10-7164-4d8f-9843-efc57d535028 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] [instance: 629b5a40-87b1-42c3-91c7-5731966c0654] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:27.645578 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-328efc10-7164-4d8f-9843-efc57d535028 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:27.646358 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-328efc10-7164-4d8f-9843-efc57d535028 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:27.647069 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-328efc10-7164-4d8f-9843-efc57d535028 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:27.648003 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-328efc10-7164-4d8f-9843-efc57d535028 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:27.648859 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-328efc10-7164-4d8f-9843-efc57d535028 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:27.649504 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-328efc10-7164-4d8f-9843-efc57d535028 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:27.655242 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell1:SELECT=100 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:27.950169 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-27630f24-06b5-4a86-bf42-055e1a15430d tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:27.954542 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell1:SELECT=100 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:27.963302 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-27630f24-06b5-4a86-bf42-055e1a15430d tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da" status: 200 len: 1367 microversion: 2.1 time: 0.883131 Aug 09 11:18:27.964055 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 39/69] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:27 2022] GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da => generated 1367 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:27.983000 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell0:SELECT=6 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:28.104710 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-7c0f378c-9ca8-45ba-96cc-46d699f8bbb4 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:28.106105 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-7c0f378c-9ca8-45ba-96cc-46d699f8bbb4 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:28.116964 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-328efc10-7164-4d8f-9843-efc57d535028 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c8a0130c8e42c5b4a6ffe43d15865e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8459b14a54824536b415b2b7336389df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:28.122209 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7c0f378c-9ca8-45ba-96cc-46d699f8bbb4 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:28.123003 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7c0f378c-9ca8-45ba-96cc-46d699f8bbb4 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:28.124767 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7c0f378c-9ca8-45ba-96cc-46d699f8bbb4 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:28.127618 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7c0f378c-9ca8-45ba-96cc-46d699f8bbb4 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:28.128365 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7c0f378c-9ca8-45ba-96cc-46d699f8bbb4 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:28.129114 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7c0f378c-9ca8-45ba-96cc-46d699f8bbb4 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:28.137508 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-328efc10-7164-4d8f-9843-efc57d535028 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] 10.222.0.27 "GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654" status: 200 len: 1314 microversion: 2.1 time: 0.519963 Aug 09 11:18:28.158591 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 31/70] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:27 2022] GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654 => generated 1314 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:18:28.166865 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-575b4f14-da17-4aba-9811-3903c33ee9d0 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:28.169352 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-575b4f14-da17-4aba-9811-3903c33ee9d0 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:28.182161 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-575b4f14-da17-4aba-9811-3903c33ee9d0 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:28.185454 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-575b4f14-da17-4aba-9811-3903c33ee9d0 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:28.185923 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-575b4f14-da17-4aba-9811-3903c33ee9d0 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:28.188328 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-575b4f14-da17-4aba-9811-3903c33ee9d0 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:28.188771 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-575b4f14-da17-4aba-9811-3903c33ee9d0 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:28.190377 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-575b4f14-da17-4aba-9811-3903c33ee9d0 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:28.495176 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell0:SELECT=26 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:28.712258 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-7c0f378c-9ca8-45ba-96cc-46d699f8bbb4 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:28.712462 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-575b4f14-da17-4aba-9811-3903c33ee9d0 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:28.724821 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-575b4f14-da17-4aba-9811-3903c33ee9d0 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1362 microversion: 2.1 time: 0.564293 Aug 09 11:18:28.725912 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-7c0f378c-9ca8-45ba-96cc-46d699f8bbb4 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:28.729193 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-7c0f378c-9ca8-45ba-96cc-46d699f8bbb4 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:28.730805 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-7c0f378c-9ca8-45ba-96cc-46d699f8bbb4 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1406 microversion: 2.20 time: 0.636320 Aug 09 11:18:28.737955 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 32/71] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:28 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1362 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:28.740746 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 40/72] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:18:28 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1406 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 11:18:28.749211 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-82cf4059-a827-4ce4-847f-f7ad98a1f08b req-d3ad70d9-83d1-4233-8dce-9d8714e15ebf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1329e8e9-9358-454d-bea3-dad19dfc53da", "tag": "b3947c96-3346-4577-96e3-f0591b58e37f"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:18:28.760996 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-82cf4059-a827-4ce4-847f-f7ad98a1f08b req-d3ad70d9-83d1-4233-8dce-9d8714e15ebf service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:28.761931 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-82cf4059-a827-4ce4-847f-f7ad98a1f08b req-d3ad70d9-83d1-4233-8dce-9d8714e15ebf service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:28.762427 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-82cf4059-a827-4ce4-847f-f7ad98a1f08b req-d3ad70d9-83d1-4233-8dce-9d8714e15ebf service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:28.776732 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-82cf4059-a827-4ce4-847f-f7ad98a1f08b req-d3ad70d9-83d1-4233-8dce-9d8714e15ebf service nova] Creating event network-changed:b3947c96-3346-4577-96e3-f0591b58e37f for instance 1329e8e9-9358-454d-bea3-dad19dfc53da on hv-cinder-85251 Aug 09 11:18:28.784547 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-82cf4059-a827-4ce4-847f-f7ad98a1f08b req-d3ad70d9-83d1-4233-8dce-9d8714e15ebf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044838 Aug 09 11:18:28.786385 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 33/73] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:18:28.985938 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-b7085fc6-71b4-4549-89a4-cfb25e8a6d58 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:28.986703 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-b7085fc6-71b4-4549-89a4-cfb25e8a6d58 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 1329e8e9-9358-454d-bea3-dad19dfc53da] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:29.000040 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b7085fc6-71b4-4549-89a4-cfb25e8a6d58 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:29.000651 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b7085fc6-71b4-4549-89a4-cfb25e8a6d58 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:29.001789 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b7085fc6-71b4-4549-89a4-cfb25e8a6d58 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:29.003543 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b7085fc6-71b4-4549-89a4-cfb25e8a6d58 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:29.006924 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b7085fc6-71b4-4549-89a4-cfb25e8a6d58 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:29.007184 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b7085fc6-71b4-4549-89a4-cfb25e8a6d58 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:29.160959 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell0:SELECT=4 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:29.166535 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-bfb77556-9550-4a32-a27e-a80f67a83d1b tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:29.167494 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-bfb77556-9550-4a32-a27e-a80f67a83d1b tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] [instance: 629b5a40-87b1-42c3-91c7-5731966c0654] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:29.177751 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bfb77556-9550-4a32-a27e-a80f67a83d1b tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:29.178607 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bfb77556-9550-4a32-a27e-a80f67a83d1b tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:29.179157 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bfb77556-9550-4a32-a27e-a80f67a83d1b tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:29.180223 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bfb77556-9550-4a32-a27e-a80f67a83d1b tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:29.181044 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bfb77556-9550-4a32-a27e-a80f67a83d1b tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:29.181657 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bfb77556-9550-4a32-a27e-a80f67a83d1b tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:29.231931 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-b7085fc6-71b4-4549-89a4-cfb25e8a6d58 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:29.243284 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-b7085fc6-71b4-4549-89a4-cfb25e8a6d58 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da" status: 200 len: 1367 microversion: 2.1 time: 0.262512 Aug 09 11:18:29.243774 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 41/74] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:28 2022] GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da => generated 1367 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:29.384903 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-bfb77556-9550-4a32-a27e-a80f67a83d1b tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c8a0130c8e42c5b4a6ffe43d15865e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8459b14a54824536b415b2b7336389df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:29.394996 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-bfb77556-9550-4a32-a27e-a80f67a83d1b tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] 10.222.0.27 "GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654" status: 200 len: 1314 microversion: 2.1 time: 0.235445 Aug 09 11:18:29.400396 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 34/75] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:29 2022] GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:29.747051 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-b6bdab8d-4b4b-411b-9bcb-a6a0c76804a4 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:29.755719 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-155cc7e3-b9d3-431f-abf1-7bbccf4b8f38 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:29.756941 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-155cc7e3-b9d3-431f-abf1-7bbccf4b8f38 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:29.757311 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-b6bdab8d-4b4b-411b-9bcb-a6a0c76804a4 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:29.776926 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-155cc7e3-b9d3-431f-abf1-7bbccf4b8f38 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:29.778738 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b6bdab8d-4b4b-411b-9bcb-a6a0c76804a4 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:29.779496 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b6bdab8d-4b4b-411b-9bcb-a6a0c76804a4 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:29.782353 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-155cc7e3-b9d3-431f-abf1-7bbccf4b8f38 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:29.783191 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-155cc7e3-b9d3-431f-abf1-7bbccf4b8f38 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:29.783547 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b6bdab8d-4b4b-411b-9bcb-a6a0c76804a4 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:29.784418 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b6bdab8d-4b4b-411b-9bcb-a6a0c76804a4 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:29.785337 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-155cc7e3-b9d3-431f-abf1-7bbccf4b8f38 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:29.786744 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b6bdab8d-4b4b-411b-9bcb-a6a0c76804a4 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:29.787317 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-155cc7e3-b9d3-431f-abf1-7bbccf4b8f38 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:29.788093 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b6bdab8d-4b4b-411b-9bcb-a6a0c76804a4 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:29.788844 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-155cc7e3-b9d3-431f-abf1-7bbccf4b8f38 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:30.418302 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-b6bdab8d-4b4b-411b-9bcb-a6a0c76804a4 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:30.426871 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-b6bdab8d-4b4b-411b-9bcb-a6a0c76804a4 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1362 microversion: 2.1 time: 0.684721 Aug 09 11:18:30.440855 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 42/76] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:29 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1362 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:30.441330 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-155cc7e3-b9d3-431f-abf1-7bbccf4b8f38 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:30.448937 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-155cc7e3-b9d3-431f-abf1-7bbccf4b8f38 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:30.450362 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-155cc7e3-b9d3-431f-abf1-7bbccf4b8f38 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:30.452402 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-155cc7e3-b9d3-431f-abf1-7bbccf4b8f38 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1406 microversion: 2.20 time: 0.700207 Aug 09 11:18:30.460359 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 35/77] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:18:29 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1406 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:18:30.460359 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-8a23ef0e-7099-4452-ace8-af36236626e1 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:30.460359 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-8a23ef0e-7099-4452-ace8-af36236626e1 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 1329e8e9-9358-454d-bea3-dad19dfc53da] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:30.465593 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8a23ef0e-7099-4452-ace8-af36236626e1 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:30.466271 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8a23ef0e-7099-4452-ace8-af36236626e1 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:30.466847 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8a23ef0e-7099-4452-ace8-af36236626e1 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:30.467680 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8a23ef0e-7099-4452-ace8-af36236626e1 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:30.468257 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8a23ef0e-7099-4452-ace8-af36236626e1 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:30.469169 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8a23ef0e-7099-4452-ace8-af36236626e1 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:30.644165 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell0:SELECT=4 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:30.727122 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-8a23ef0e-7099-4452-ace8-af36236626e1 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:30.735766 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-8a23ef0e-7099-4452-ace8-af36236626e1 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da" status: 200 len: 1367 microversion: 2.1 time: 0.281178 Aug 09 11:18:30.740649 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 36/78] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:30 2022] GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da => generated 1367 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:30.742655 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-83ed2df3-ad13-4d07-a921-e50b206e27c6 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:30.743849 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-83ed2df3-ad13-4d07-a921-e50b206e27c6 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] [instance: 629b5a40-87b1-42c3-91c7-5731966c0654] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:30.751350 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-83ed2df3-ad13-4d07-a921-e50b206e27c6 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:30.752025 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-83ed2df3-ad13-4d07-a921-e50b206e27c6 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:30.752651 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-83ed2df3-ad13-4d07-a921-e50b206e27c6 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:30.753623 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-83ed2df3-ad13-4d07-a921-e50b206e27c6 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:30.754252 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-83ed2df3-ad13-4d07-a921-e50b206e27c6 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:30.754852 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-83ed2df3-ad13-4d07-a921-e50b206e27c6 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:30.797316 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [req-91344aac-cf85-4b91-a407-b3701c0cd401 req-21fb0de5-ff1d-4d0e-b5ba-a9319ab3baba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb805071-5bf8-4c52-9f89-b4bb1272121f", "name": "network-vif-plugged", "status": "completed", "tag": "9c7f1d85-6e6c-4baa-88fa-0db4c9faf571"}]} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:18:30.807424 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-91344aac-cf85-4b91-a407-b3701c0cd401 req-21fb0de5-ff1d-4d0e-b5ba-a9319ab3baba service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:30.808076 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-91344aac-cf85-4b91-a407-b3701c0cd401 req-21fb0de5-ff1d-4d0e-b5ba-a9319ab3baba service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:30.808746 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-91344aac-cf85-4b91-a407-b3701c0cd401 req-21fb0de5-ff1d-4d0e-b5ba-a9319ab3baba service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:30.821177 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.compute.server_external_events [req-91344aac-cf85-4b91-a407-b3701c0cd401 req-21fb0de5-ff1d-4d0e-b5ba-a9319ab3baba service nova] Creating event network-vif-plugged:9c7f1d85-6e6c-4baa-88fa-0db4c9faf571 for instance fb805071-5bf8-4c52-9f89-b4bb1272121f on hv-cinder-85251 Aug 09 11:18:30.826435 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [req-91344aac-cf85-4b91-a407-b3701c0cd401 req-21fb0de5-ff1d-4d0e-b5ba-a9319ab3baba service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.394070 Aug 09 11:18:30.831578 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 43/79] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:18:31.088217 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-83ed2df3-ad13-4d07-a921-e50b206e27c6 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c8a0130c8e42c5b4a6ffe43d15865e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8459b14a54824536b415b2b7336389df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:31.097026 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-83ed2df3-ad13-4d07-a921-e50b206e27c6 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] 10.222.0.27 "GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654" status: 200 len: 1314 microversion: 2.1 time: 0.358846 Aug 09 11:18:31.097841 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 37/80] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:30 2022] GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654 => generated 1314 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:31.451371 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-89e5e507-f75e-431f-9b2e-153f6cb9d783 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:31.452044 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-89e5e507-f75e-431f-9b2e-153f6cb9d783 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:31.467260 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-89e5e507-f75e-431f-9b2e-153f6cb9d783 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:31.467748 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-89e5e507-f75e-431f-9b2e-153f6cb9d783 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:31.468210 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-89e5e507-f75e-431f-9b2e-153f6cb9d783 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:31.470308 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-89e5e507-f75e-431f-9b2e-153f6cb9d783 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:31.470308 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-89e5e507-f75e-431f-9b2e-153f6cb9d783 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:31.470308 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-89e5e507-f75e-431f-9b2e-153f6cb9d783 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:31.478718 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-994d3c5f-3425-4518-bae7-29b6d26cbff1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:31.479670 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-994d3c5f-3425-4518-bae7-29b6d26cbff1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:31.489650 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-994d3c5f-3425-4518-bae7-29b6d26cbff1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:31.490331 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-994d3c5f-3425-4518-bae7-29b6d26cbff1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:31.490806 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-994d3c5f-3425-4518-bae7-29b6d26cbff1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:31.492235 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-994d3c5f-3425-4518-bae7-29b6d26cbff1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:31.493142 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-994d3c5f-3425-4518-bae7-29b6d26cbff1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:31.493673 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-994d3c5f-3425-4518-bae7-29b6d26cbff1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:31.939702 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-994d3c5f-3425-4518-bae7-29b6d26cbff1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:31.953861 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-994d3c5f-3425-4518-bae7-29b6d26cbff1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:31.956446 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-89e5e507-f75e-431f-9b2e-153f6cb9d783 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:31.958790 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-994d3c5f-3425-4518-bae7-29b6d26cbff1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:31.960301 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-994d3c5f-3425-4518-bae7-29b6d26cbff1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1406 microversion: 2.20 time: 0.488630 Aug 09 11:18:31.963797 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 38/81] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:18:31 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1406 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 11:18:31.969221 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-186fde73-1199-4494-b811-3c5c5d953956 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:31.971999 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-186fde73-1199-4494-b811-3c5c5d953956 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 1329e8e9-9358-454d-bea3-dad19dfc53da] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:31.978988 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-89e5e507-f75e-431f-9b2e-153f6cb9d783 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1362 microversion: 2.1 time: 0.531871 Aug 09 11:18:31.987324 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-186fde73-1199-4494-b811-3c5c5d953956 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:31.988202 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-186fde73-1199-4494-b811-3c5c5d953956 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:31.990290 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-186fde73-1199-4494-b811-3c5c5d953956 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:31.992243 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-186fde73-1199-4494-b811-3c5c5d953956 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:31.993638 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 44/82] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:31 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1362 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:31.994149 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-186fde73-1199-4494-b811-3c5c5d953956 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:31.995333 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-186fde73-1199-4494-b811-3c5c5d953956 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:32.118318 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-5e85fb95-fe9a-4aeb-bacb-8959076e419c tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:32.118847 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-5e85fb95-fe9a-4aeb-bacb-8959076e419c tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] [instance: 629b5a40-87b1-42c3-91c7-5731966c0654] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:32.129720 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5e85fb95-fe9a-4aeb-bacb-8959076e419c tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:32.130980 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5e85fb95-fe9a-4aeb-bacb-8959076e419c tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:32.132016 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5e85fb95-fe9a-4aeb-bacb-8959076e419c tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:32.133928 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5e85fb95-fe9a-4aeb-bacb-8959076e419c tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:32.134739 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5e85fb95-fe9a-4aeb-bacb-8959076e419c tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:32.142971 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5e85fb95-fe9a-4aeb-bacb-8959076e419c tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:32.447145 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-186fde73-1199-4494-b811-3c5c5d953956 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:32.454817 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-186fde73-1199-4494-b811-3c5c5d953956 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da" status: 200 len: 1367 microversion: 2.1 time: 0.489565 Aug 09 11:18:32.467812 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 39/83] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:31 2022] GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da => generated 1367 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:32.517949 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-5e85fb95-fe9a-4aeb-bacb-8959076e419c tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c8a0130c8e42c5b4a6ffe43d15865e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8459b14a54824536b415b2b7336389df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:32.525902 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-5e85fb95-fe9a-4aeb-bacb-8959076e419c tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] 10.222.0.27 "GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654" status: 200 len: 1314 microversion: 2.1 time: 0.411845 Aug 09 11:18:32.526482 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 45/84] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:32 2022] GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654 => generated 1314 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:32.842853 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-36b4890c-aa58-4c3d-bb0e-e49d68de71ec req-ef40c024-7af2-45ce-a1fe-302de489c750 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "629b5a40-87b1-42c3-91c7-5731966c0654", "name": "network-vif-plugged", "status": "completed", "tag": "2af6391a-f3a9-41ef-8789-72d123f8468e"}, {"server_uuid": "69542c8c-90b6-49a4-aed3-c229168f215f", "name": "network-vif-plugged", "status": "completed", "tag": "e9e1072a-3971-440e-9a60-ba15e5db60f3"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:18:32.853295 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-36b4890c-aa58-4c3d-bb0e-e49d68de71ec req-ef40c024-7af2-45ce-a1fe-302de489c750 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:32.853772 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-36b4890c-aa58-4c3d-bb0e-e49d68de71ec req-ef40c024-7af2-45ce-a1fe-302de489c750 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:32.854199 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-36b4890c-aa58-4c3d-bb0e-e49d68de71ec req-ef40c024-7af2-45ce-a1fe-302de489c750 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:32.867702 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-36b4890c-aa58-4c3d-bb0e-e49d68de71ec req-ef40c024-7af2-45ce-a1fe-302de489c750 service nova] Creating event network-vif-plugged:2af6391a-f3a9-41ef-8789-72d123f8468e for instance 629b5a40-87b1-42c3-91c7-5731966c0654 on hv-cinder-85251 Aug 09 11:18:32.868242 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-36b4890c-aa58-4c3d-bb0e-e49d68de71ec req-ef40c024-7af2-45ce-a1fe-302de489c750 service nova] Creating event network-vif-plugged:e9e1072a-3971-440e-9a60-ba15e5db60f3 for instance 69542c8c-90b6-49a4-aed3-c229168f215f on hv-cinder-85251 Aug 09 11:18:32.875076 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-36b4890c-aa58-4c3d-bb0e-e49d68de71ec req-ef40c024-7af2-45ce-a1fe-302de489c750 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036264 Aug 09 11:18:32.875679 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 40/85] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:18:32.989283 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-d13a481b-4c54-4539-8608-6fba9534cb7d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:32.989980 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-d13a481b-4c54-4539-8608-6fba9534cb7d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:32.996439 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d13a481b-4c54-4539-8608-6fba9534cb7d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:32.997045 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d13a481b-4c54-4539-8608-6fba9534cb7d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:32.997839 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d13a481b-4c54-4539-8608-6fba9534cb7d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:32.999656 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d13a481b-4c54-4539-8608-6fba9534cb7d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:33.000247 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d13a481b-4c54-4539-8608-6fba9534cb7d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:33.000825 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d13a481b-4c54-4539-8608-6fba9534cb7d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:33.001453 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-4011ec82-2af9-4c82-90cd-e9579a1edd59 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:33.002162 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-4011ec82-2af9-4c82-90cd-e9579a1edd59 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:33.009013 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4011ec82-2af9-4c82-90cd-e9579a1edd59 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:33.009482 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4011ec82-2af9-4c82-90cd-e9579a1edd59 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:33.009923 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4011ec82-2af9-4c82-90cd-e9579a1edd59 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:33.010766 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4011ec82-2af9-4c82-90cd-e9579a1edd59 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:33.011080 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4011ec82-2af9-4c82-90cd-e9579a1edd59 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:33.011494 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4011ec82-2af9-4c82-90cd-e9579a1edd59 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:33.201898 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-d13a481b-4c54-4539-8608-6fba9534cb7d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:33.205979 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-4011ec82-2af9-4c82-90cd-e9579a1edd59 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:33.211817 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-d13a481b-4c54-4539-8608-6fba9534cb7d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:33.213469 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-d13a481b-4c54-4539-8608-6fba9534cb7d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:33.214475 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-4011ec82-2af9-4c82-90cd-e9579a1edd59 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1362 microversion: 2.1 time: 0.217118 Aug 09 11:18:33.216736 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-d13a481b-4c54-4539-8608-6fba9534cb7d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1406 microversion: 2.20 time: 0.231673 Aug 09 11:18:33.216972 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 41/86] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:32 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1362 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:33.232369 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 46/87] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:18:32 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1406 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:18:33.475096 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-c61d645e-c70e-4210-af0d-a289fb3624d1 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:33.475748 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-c61d645e-c70e-4210-af0d-a289fb3624d1 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 1329e8e9-9358-454d-bea3-dad19dfc53da] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:33.482893 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c61d645e-c70e-4210-af0d-a289fb3624d1 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:33.483301 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c61d645e-c70e-4210-af0d-a289fb3624d1 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:33.483728 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c61d645e-c70e-4210-af0d-a289fb3624d1 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:33.484456 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c61d645e-c70e-4210-af0d-a289fb3624d1 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:33.484897 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c61d645e-c70e-4210-af0d-a289fb3624d1 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:33.485465 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c61d645e-c70e-4210-af0d-a289fb3624d1 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:33.546703 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-05bfecd7-9d26-42f1-b5de-4e069d0fd087 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:33.547598 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-05bfecd7-9d26-42f1-b5de-4e069d0fd087 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] [instance: 629b5a40-87b1-42c3-91c7-5731966c0654] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:33.559143 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-05bfecd7-9d26-42f1-b5de-4e069d0fd087 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:33.560845 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-05bfecd7-9d26-42f1-b5de-4e069d0fd087 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:33.561273 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-05bfecd7-9d26-42f1-b5de-4e069d0fd087 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:33.564548 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-05bfecd7-9d26-42f1-b5de-4e069d0fd087 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:33.566291 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-05bfecd7-9d26-42f1-b5de-4e069d0fd087 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:33.568297 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-05bfecd7-9d26-42f1-b5de-4e069d0fd087 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:33.837508 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-c61d645e-c70e-4210-af0d-a289fb3624d1 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:33.860950 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-c61d645e-c70e-4210-af0d-a289fb3624d1 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da" status: 200 len: 1367 microversion: 2.1 time: 0.389335 Aug 09 11:18:33.862406 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 42/88] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:33 2022] GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da => generated 1367 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:33.885293 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-05bfecd7-9d26-42f1-b5de-4e069d0fd087 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c8a0130c8e42c5b4a6ffe43d15865e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8459b14a54824536b415b2b7336389df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:33.895110 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-05bfecd7-9d26-42f1-b5de-4e069d0fd087 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] 10.222.0.27 "GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654" status: 200 len: 1314 microversion: 2.1 time: 0.352250 Aug 09 11:18:33.895990 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 47/89] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:33 2022] GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654 => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:34.236496 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-a2da3f4d-c91c-48a5-88dc-6a50b90f94be tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:34.237113 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-a2da3f4d-c91c-48a5-88dc-6a50b90f94be tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:34.239238 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-7b675818-16e9-4b3b-bd01-1a21d964ee4f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:34.239796 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-7b675818-16e9-4b3b-bd01-1a21d964ee4f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:34.243566 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a2da3f4d-c91c-48a5-88dc-6a50b90f94be tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:34.244252 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a2da3f4d-c91c-48a5-88dc-6a50b90f94be tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:34.244711 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a2da3f4d-c91c-48a5-88dc-6a50b90f94be tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:34.245436 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a2da3f4d-c91c-48a5-88dc-6a50b90f94be tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:34.246038 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a2da3f4d-c91c-48a5-88dc-6a50b90f94be tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:34.246563 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a2da3f4d-c91c-48a5-88dc-6a50b90f94be tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:34.249610 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7b675818-16e9-4b3b-bd01-1a21d964ee4f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:34.251098 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7b675818-16e9-4b3b-bd01-1a21d964ee4f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:34.251700 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7b675818-16e9-4b3b-bd01-1a21d964ee4f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:34.252455 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7b675818-16e9-4b3b-bd01-1a21d964ee4f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:34.252911 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7b675818-16e9-4b3b-bd01-1a21d964ee4f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:34.254606 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7b675818-16e9-4b3b-bd01-1a21d964ee4f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:34.456668 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-a2da3f4d-c91c-48a5-88dc-6a50b90f94be tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:34.465085 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-a2da3f4d-c91c-48a5-88dc-6a50b90f94be tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1362 microversion: 2.1 time: 0.232698 Aug 09 11:18:34.466031 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 43/90] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:34 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:34.493565 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-7b675818-16e9-4b3b-bd01-1a21d964ee4f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:34.502350 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-7b675818-16e9-4b3b-bd01-1a21d964ee4f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:34.503868 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-7b675818-16e9-4b3b-bd01-1a21d964ee4f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:34.505182 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-7b675818-16e9-4b3b-bd01-1a21d964ee4f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1406 microversion: 2.20 time: 0.270075 Aug 09 11:18:34.505757 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 48/91] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:18:34 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1406 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:18:34.885685 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-7271dc2c-48d9-46c9-8d81-510b2b798835 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:34.886349 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-7271dc2c-48d9-46c9-8d81-510b2b798835 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 1329e8e9-9358-454d-bea3-dad19dfc53da] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:34.895895 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7271dc2c-48d9-46c9-8d81-510b2b798835 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:34.896537 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7271dc2c-48d9-46c9-8d81-510b2b798835 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:34.897912 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7271dc2c-48d9-46c9-8d81-510b2b798835 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:34.898913 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7271dc2c-48d9-46c9-8d81-510b2b798835 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:34.899679 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7271dc2c-48d9-46c9-8d81-510b2b798835 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:34.900353 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7271dc2c-48d9-46c9-8d81-510b2b798835 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:34.931580 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-3f08b9df-c5fe-406f-bc48-7242f06531ed tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:34.932331 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-3f08b9df-c5fe-406f-bc48-7242f06531ed tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] [instance: 629b5a40-87b1-42c3-91c7-5731966c0654] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:34.939285 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3f08b9df-c5fe-406f-bc48-7242f06531ed tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:34.939753 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3f08b9df-c5fe-406f-bc48-7242f06531ed tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:34.940182 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3f08b9df-c5fe-406f-bc48-7242f06531ed tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:34.949707 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3f08b9df-c5fe-406f-bc48-7242f06531ed tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:34.950464 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3f08b9df-c5fe-406f-bc48-7242f06531ed tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:34.951062 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3f08b9df-c5fe-406f-bc48-7242f06531ed tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:35.177326 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-7271dc2c-48d9-46c9-8d81-510b2b798835 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:35.183936 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-3f08b9df-c5fe-406f-bc48-7242f06531ed tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c8a0130c8e42c5b4a6ffe43d15865e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8459b14a54824536b415b2b7336389df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:35.194763 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-7271dc2c-48d9-46c9-8d81-510b2b798835 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da" status: 200 len: 1367 microversion: 2.1 time: 0.314972 Aug 09 11:18:35.195035 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-3f08b9df-c5fe-406f-bc48-7242f06531ed tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] 10.222.0.27 "GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654" status: 200 len: 1314 microversion: 2.1 time: 0.278612 Aug 09 11:18:35.195497 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 44/92] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:34 2022] GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da => generated 1367 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:35.195742 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 49/93] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:34 2022] GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:35.217845 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-3d890f18-c20d-4225-b1b0-5679ea5cb7cd req-13bb7494-bf28-4743-a66e-6b9a018a282d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1329e8e9-9358-454d-bea3-dad19dfc53da", "name": "network-vif-plugged", "status": "completed", "tag": "b3947c96-3346-4577-96e3-f0591b58e37f"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:18:35.222471 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-3d890f18-c20d-4225-b1b0-5679ea5cb7cd req-13bb7494-bf28-4743-a66e-6b9a018a282d service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:35.223022 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-3d890f18-c20d-4225-b1b0-5679ea5cb7cd req-13bb7494-bf28-4743-a66e-6b9a018a282d service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:35.223467 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-3d890f18-c20d-4225-b1b0-5679ea5cb7cd req-13bb7494-bf28-4743-a66e-6b9a018a282d service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:35.235484 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-3d890f18-c20d-4225-b1b0-5679ea5cb7cd req-13bb7494-bf28-4743-a66e-6b9a018a282d service nova] Creating event network-vif-plugged:b3947c96-3346-4577-96e3-f0591b58e37f for instance 1329e8e9-9358-454d-bea3-dad19dfc53da on hv-cinder-85251 Aug 09 11:18:35.241270 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-3d890f18-c20d-4225-b1b0-5679ea5cb7cd req-13bb7494-bf28-4743-a66e-6b9a018a282d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032338 Aug 09 11:18:35.241945 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 45/94] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:18:35.486699 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-53e59e0c-0d14-4dbf-83c0-cf4ce7d774aa tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:35.487605 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-53e59e0c-0d14-4dbf-83c0-cf4ce7d774aa tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:35.498199 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-53e59e0c-0d14-4dbf-83c0-cf4ce7d774aa tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:35.498825 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-53e59e0c-0d14-4dbf-83c0-cf4ce7d774aa tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:35.499312 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-53e59e0c-0d14-4dbf-83c0-cf4ce7d774aa tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:35.500314 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-53e59e0c-0d14-4dbf-83c0-cf4ce7d774aa tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:35.500789 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-53e59e0c-0d14-4dbf-83c0-cf4ce7d774aa tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:35.501208 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-53e59e0c-0d14-4dbf-83c0-cf4ce7d774aa tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:35.531259 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-f37df7b3-1f01-4a10-870b-f581e6f9b741 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:35.533149 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-f37df7b3-1f01-4a10-870b-f581e6f9b741 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:35.541035 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f37df7b3-1f01-4a10-870b-f581e6f9b741 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:35.541525 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f37df7b3-1f01-4a10-870b-f581e6f9b741 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:35.541946 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f37df7b3-1f01-4a10-870b-f581e6f9b741 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:35.542864 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f37df7b3-1f01-4a10-870b-f581e6f9b741 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:35.543320 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f37df7b3-1f01-4a10-870b-f581e6f9b741 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:35.543712 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f37df7b3-1f01-4a10-870b-f581e6f9b741 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:35.703385 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-53e59e0c-0d14-4dbf-83c0-cf4ce7d774aa tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:35.711097 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-53e59e0c-0d14-4dbf-83c0-cf4ce7d774aa tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1362 microversion: 2.1 time: 0.228397 Aug 09 11:18:35.711927 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 50/95] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:35 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1362 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:35.736805 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-f37df7b3-1f01-4a10-870b-f581e6f9b741 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:35.745607 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-f37df7b3-1f01-4a10-870b-f581e6f9b741 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:35.747384 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-f37df7b3-1f01-4a10-870b-f581e6f9b741 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:35.748749 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-f37df7b3-1f01-4a10-870b-f581e6f9b741 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1406 microversion: 2.20 time: 0.222501 Aug 09 11:18:35.750037 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 46/96] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:18:35 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1406 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 11:18:36.216637 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-440968e3-7e09-4690-95f9-b7dd4ed67857 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:36.220851 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-dc58c6eb-5b39-4a7a-8d69-a33062c7fcdf tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:36.221979 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-dc58c6eb-5b39-4a7a-8d69-a33062c7fcdf tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 1329e8e9-9358-454d-bea3-dad19dfc53da] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:36.222820 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-440968e3-7e09-4690-95f9-b7dd4ed67857 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] [instance: 629b5a40-87b1-42c3-91c7-5731966c0654] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:36.234054 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-dc58c6eb-5b39-4a7a-8d69-a33062c7fcdf tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:36.235846 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-440968e3-7e09-4690-95f9-b7dd4ed67857 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:36.236470 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-440968e3-7e09-4690-95f9-b7dd4ed67857 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:36.236895 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-440968e3-7e09-4690-95f9-b7dd4ed67857 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:36.237597 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-440968e3-7e09-4690-95f9-b7dd4ed67857 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:36.238039 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-440968e3-7e09-4690-95f9-b7dd4ed67857 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:36.238449 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-440968e3-7e09-4690-95f9-b7dd4ed67857 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:36.239153 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-dc58c6eb-5b39-4a7a-8d69-a33062c7fcdf tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:36.239566 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-dc58c6eb-5b39-4a7a-8d69-a33062c7fcdf tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:36.240442 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-dc58c6eb-5b39-4a7a-8d69-a33062c7fcdf tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:36.240884 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-dc58c6eb-5b39-4a7a-8d69-a33062c7fcdf tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:36.241360 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-dc58c6eb-5b39-4a7a-8d69-a33062c7fcdf tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:36.525310 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-dc58c6eb-5b39-4a7a-8d69-a33062c7fcdf tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:36.532705 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-440968e3-7e09-4690-95f9-b7dd4ed67857 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c8a0130c8e42c5b4a6ffe43d15865e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8459b14a54824536b415b2b7336389df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:36.540615 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-dc58c6eb-5b39-4a7a-8d69-a33062c7fcdf tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da" status: 200 len: 1367 microversion: 2.1 time: 0.328752 Aug 09 11:18:36.541331 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 47/97] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:36 2022] GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da => generated 1367 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:36.545498 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-440968e3-7e09-4690-95f9-b7dd4ed67857 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] 10.222.0.27 "GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654" status: 200 len: 1314 microversion: 2.1 time: 0.332577 Aug 09 11:18:36.546486 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 51/98] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:36 2022] GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654 => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:36.733573 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-a5d3963e-59a6-4f89-ab93-d241b30d3083 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:36.734424 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-a5d3963e-59a6-4f89-ab93-d241b30d3083 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:36.741019 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a5d3963e-59a6-4f89-ab93-d241b30d3083 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:36.741579 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a5d3963e-59a6-4f89-ab93-d241b30d3083 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:36.742019 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a5d3963e-59a6-4f89-ab93-d241b30d3083 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:36.743073 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a5d3963e-59a6-4f89-ab93-d241b30d3083 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:36.743529 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a5d3963e-59a6-4f89-ab93-d241b30d3083 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:36.744180 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a5d3963e-59a6-4f89-ab93-d241b30d3083 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:36.772446 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-b433fb30-9792-44b1-a296-65166451383e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:36.773480 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-b433fb30-9792-44b1-a296-65166451383e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:36.783183 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b433fb30-9792-44b1-a296-65166451383e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:36.784654 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b433fb30-9792-44b1-a296-65166451383e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:36.792713 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b433fb30-9792-44b1-a296-65166451383e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:36.795874 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b433fb30-9792-44b1-a296-65166451383e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:36.797752 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b433fb30-9792-44b1-a296-65166451383e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:36.799302 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b433fb30-9792-44b1-a296-65166451383e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:37.041868 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-a5d3963e-59a6-4f89-ab93-d241b30d3083 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:37.051349 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-b433fb30-9792-44b1-a296-65166451383e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:37.057585 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-a5d3963e-59a6-4f89-ab93-d241b30d3083 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1548 microversion: 2.1 time: 0.328061 Aug 09 11:18:37.058569 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 48/99] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:36 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1548 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:18:37.064812 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-b433fb30-9792-44b1-a296-65166451383e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:37.066819 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-b433fb30-9792-44b1-a296-65166451383e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:37.068448 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-b433fb30-9792-44b1-a296-65166451383e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1406 microversion: 2.20 time: 0.300205 Aug 09 11:18:37.070010 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 52/100] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:18:36 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1406 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:18:37.091252 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-34ee25f8-28f0-43ea-aec3-07b4aa54d897 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:37.091748 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-34ee25f8-28f0-43ea-aec3-07b4aa54d897 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:37.098110 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-34ee25f8-28f0-43ea-aec3-07b4aa54d897 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:37.098601 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-34ee25f8-28f0-43ea-aec3-07b4aa54d897 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:37.099021 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-34ee25f8-28f0-43ea-aec3-07b4aa54d897 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:37.099897 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-34ee25f8-28f0-43ea-aec3-07b4aa54d897 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:37.100360 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-34ee25f8-28f0-43ea-aec3-07b4aa54d897 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:37.100939 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-34ee25f8-28f0-43ea-aec3-07b4aa54d897 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:37.298040 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-34ee25f8-28f0-43ea-aec3-07b4aa54d897 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.210841 Aug 09 11:18:37.306109 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 49/101] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Aug 9 11:18:37 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f/os-interface => generated 284 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:18:37.568981 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-132a676a-9c41-459d-bfd0-5ee32d32e1e9 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:37.571874 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-132a676a-9c41-459d-bfd0-5ee32d32e1e9 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] [instance: 629b5a40-87b1-42c3-91c7-5731966c0654] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:37.572451 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-fa92253b-6a08-43ad-9890-8af16ddf4f4b tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:37.573717 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-fa92253b-6a08-43ad-9890-8af16ddf4f4b tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 1329e8e9-9358-454d-bea3-dad19dfc53da] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:37.585053 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-132a676a-9c41-459d-bfd0-5ee32d32e1e9 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:37.608237 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-fa92253b-6a08-43ad-9890-8af16ddf4f4b tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:37.608600 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-132a676a-9c41-459d-bfd0-5ee32d32e1e9 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:37.612762 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-132a676a-9c41-459d-bfd0-5ee32d32e1e9 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:37.613086 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-fa92253b-6a08-43ad-9890-8af16ddf4f4b tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:37.613895 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-132a676a-9c41-459d-bfd0-5ee32d32e1e9 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:37.614453 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-fa92253b-6a08-43ad-9890-8af16ddf4f4b tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:37.615295 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-fa92253b-6a08-43ad-9890-8af16ddf4f4b tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:37.619004 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-132a676a-9c41-459d-bfd0-5ee32d32e1e9 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:37.619537 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-132a676a-9c41-459d-bfd0-5ee32d32e1e9 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:37.620341 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-fa92253b-6a08-43ad-9890-8af16ddf4f4b tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:37.620757 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-fa92253b-6a08-43ad-9890-8af16ddf4f4b tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:37.635507 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell1:SELECT=100 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:38.059891 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-fa92253b-6a08-43ad-9890-8af16ddf4f4b tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:38.070204 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-fa92253b-6a08-43ad-9890-8af16ddf4f4b tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da" status: 200 len: 1367 microversion: 2.1 time: 0.511036 Aug 09 11:18:38.070916 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 53/102] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:37 2022] GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da => generated 1367 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:38.094489 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-16dad93a-55ed-41de-a06a-c4742cf87da4 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:38.097259 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-16dad93a-55ed-41de-a06a-c4742cf87da4 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:38.104140 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-132a676a-9c41-459d-bfd0-5ee32d32e1e9 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c8a0130c8e42c5b4a6ffe43d15865e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8459b14a54824536b415b2b7336389df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:38.105570 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-16dad93a-55ed-41de-a06a-c4742cf87da4 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:38.106257 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-16dad93a-55ed-41de-a06a-c4742cf87da4 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:38.106879 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-16dad93a-55ed-41de-a06a-c4742cf87da4 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:38.107774 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-16dad93a-55ed-41de-a06a-c4742cf87da4 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:38.108455 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-16dad93a-55ed-41de-a06a-c4742cf87da4 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:38.109090 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-16dad93a-55ed-41de-a06a-c4742cf87da4 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:38.115480 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-132a676a-9c41-459d-bfd0-5ee32d32e1e9 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] 10.222.0.27 "GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654" status: 200 len: 1314 microversion: 2.1 time: 0.551121 Aug 09 11:18:38.116739 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 50/103] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:37 2022] GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654 => generated 1314 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:38.633053 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-16dad93a-55ed-41de-a06a-c4742cf87da4 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:38.644368 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-16dad93a-55ed-41de-a06a-c4742cf87da4 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:38.645977 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-16dad93a-55ed-41de-a06a-c4742cf87da4 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:38.647304 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-16dad93a-55ed-41de-a06a-c4742cf87da4 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1406 microversion: 2.20 time: 0.559143 Aug 09 11:18:38.648356 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 54/104] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:18:38 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1406 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:18:39.091777 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-fc92a18d-e325-4fcf-8817-694ab6f5c476 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:39.093185 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-fc92a18d-e325-4fcf-8817-694ab6f5c476 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 1329e8e9-9358-454d-bea3-dad19dfc53da] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:39.099581 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fc92a18d-e325-4fcf-8817-694ab6f5c476 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:39.100575 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fc92a18d-e325-4fcf-8817-694ab6f5c476 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:39.101199 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fc92a18d-e325-4fcf-8817-694ab6f5c476 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:39.102263 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fc92a18d-e325-4fcf-8817-694ab6f5c476 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:39.102900 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fc92a18d-e325-4fcf-8817-694ab6f5c476 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:39.103565 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fc92a18d-e325-4fcf-8817-694ab6f5c476 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:39.141448 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-3f4c1b19-ddcc-45c9-a4ef-1eb48425ba41 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:39.142320 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-3f4c1b19-ddcc-45c9-a4ef-1eb48425ba41 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] [instance: 629b5a40-87b1-42c3-91c7-5731966c0654] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:39.154240 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3f4c1b19-ddcc-45c9-a4ef-1eb48425ba41 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:39.154731 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3f4c1b19-ddcc-45c9-a4ef-1eb48425ba41 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:39.155234 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3f4c1b19-ddcc-45c9-a4ef-1eb48425ba41 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:39.156195 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3f4c1b19-ddcc-45c9-a4ef-1eb48425ba41 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:39.156683 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3f4c1b19-ddcc-45c9-a4ef-1eb48425ba41 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:39.157095 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3f4c1b19-ddcc-45c9-a4ef-1eb48425ba41 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:39.359596 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-fc92a18d-e325-4fcf-8817-694ab6f5c476 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:39.367719 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-fc92a18d-e325-4fcf-8817-694ab6f5c476 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da" status: 200 len: 1367 microversion: 2.1 time: 0.280743 Aug 09 11:18:39.370440 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 51/105] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:39 2022] GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da => generated 1367 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:39.375017 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-9273d36e-3ad5-44c9-96f4-cc39f10390f9 req-1b408d93-fafa-4ff6-9553-7163b41479b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb805071-5bf8-4c52-9f89-b4bb1272121f", "tag": "9c7f1d85-6e6c-4baa-88fa-0db4c9faf571"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:18:39.398830 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-9273d36e-3ad5-44c9-96f4-cc39f10390f9 req-1b408d93-fafa-4ff6-9553-7163b41479b3 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:39.399395 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-9273d36e-3ad5-44c9-96f4-cc39f10390f9 req-1b408d93-fafa-4ff6-9553-7163b41479b3 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:39.402026 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-9273d36e-3ad5-44c9-96f4-cc39f10390f9 req-1b408d93-fafa-4ff6-9553-7163b41479b3 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:39.427502 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-9273d36e-3ad5-44c9-96f4-cc39f10390f9 req-1b408d93-fafa-4ff6-9553-7163b41479b3 service nova] Creating event network-changed:9c7f1d85-6e6c-4baa-88fa-0db4c9faf571 for instance fb805071-5bf8-4c52-9f89-b4bb1272121f on hv-cinder-85251 Aug 09 11:18:39.440746 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-9273d36e-3ad5-44c9-96f4-cc39f10390f9 req-1b408d93-fafa-4ff6-9553-7163b41479b3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068787 Aug 09 11:18:39.441733 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 52/106] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:18:39.457418 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-3f4c1b19-ddcc-45c9-a4ef-1eb48425ba41 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c8a0130c8e42c5b4a6ffe43d15865e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8459b14a54824536b415b2b7336389df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:39.474483 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-3f4c1b19-ddcc-45c9-a4ef-1eb48425ba41 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] 10.222.0.27 "GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654" status: 200 len: 1501 microversion: 2.1 time: 0.337134 Aug 09 11:18:39.478569 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 55/107] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:39 2022] GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654 => generated 1501 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:39.681123 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-8aa18cc2-57ff-4b72-a7b8-0d5713ce665f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:39.682066 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-8aa18cc2-57ff-4b72-a7b8-0d5713ce665f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:39.697643 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8aa18cc2-57ff-4b72-a7b8-0d5713ce665f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:39.706852 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8aa18cc2-57ff-4b72-a7b8-0d5713ce665f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:39.710031 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8aa18cc2-57ff-4b72-a7b8-0d5713ce665f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:39.710914 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8aa18cc2-57ff-4b72-a7b8-0d5713ce665f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:39.711696 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8aa18cc2-57ff-4b72-a7b8-0d5713ce665f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:39.713461 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8aa18cc2-57ff-4b72-a7b8-0d5713ce665f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:39.903752 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-8aa18cc2-57ff-4b72-a7b8-0d5713ce665f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:39.916839 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-8aa18cc2-57ff-4b72-a7b8-0d5713ce665f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:39.921791 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-8aa18cc2-57ff-4b72-a7b8-0d5713ce665f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:39.925190 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-8aa18cc2-57ff-4b72-a7b8-0d5713ce665f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1598 microversion: 2.20 time: 0.249603 Aug 09 11:18:39.929395 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 53/108] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:18:39 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1598 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:18:39.955513 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-bff2bb72-f390-4968-84e3-46f59e785085 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:39.955869 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-bff2bb72-f390-4968-84e3-46f59e785085 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:39.962797 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-bff2bb72-f390-4968-84e3-46f59e785085 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:39.967086 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-bff2bb72-f390-4968-84e3-46f59e785085 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:39.967744 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-bff2bb72-f390-4968-84e3-46f59e785085 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:39.968678 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-bff2bb72-f390-4968-84e3-46f59e785085 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:39.970667 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-bff2bb72-f390-4968-84e3-46f59e785085 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:39.973167 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-bff2bb72-f390-4968-84e3-46f59e785085 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:40.144494 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-bff2bb72-f390-4968-84e3-46f59e785085 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.193353 Aug 09 11:18:40.145216 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 56/109] 10.222.0.27 () {60 vars in 1316 bytes} [Tue Aug 9 11:18:39 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f/os-interface => generated 284 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 11:18:40.392975 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-afc2761c-0127-42b1-befc-9856acfbddd4 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:40.394898 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-afc2761c-0127-42b1-befc-9856acfbddd4 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 1329e8e9-9358-454d-bea3-dad19dfc53da] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:40.409035 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-afc2761c-0127-42b1-befc-9856acfbddd4 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:40.413236 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-afc2761c-0127-42b1-befc-9856acfbddd4 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:40.413940 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-afc2761c-0127-42b1-befc-9856acfbddd4 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:40.415089 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-afc2761c-0127-42b1-befc-9856acfbddd4 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:40.415756 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-afc2761c-0127-42b1-befc-9856acfbddd4 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:40.422417 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-afc2761c-0127-42b1-befc-9856acfbddd4 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:40.873491 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-afc2761c-0127-42b1-befc-9856acfbddd4 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:40.885646 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-afc2761c-0127-42b1-befc-9856acfbddd4 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da" status: 200 len: 1367 microversion: 2.1 time: 0.494440 Aug 09 11:18:40.887851 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 54/110] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:40 2022] GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da => generated 1367 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:41.852732 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-902c2851-8309-4c13-943d-dcc5b056116b tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "802f5333-db2c-4e3d-855c-215a77091404"}} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:18:41.857399 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-902c2851-8309-4c13-943d-dcc5b056116b tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] [instance: 629b5a40-87b1-42c3-91c7-5731966c0654] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:41.867927 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-902c2851-8309-4c13-943d-dcc5b056116b tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:41.869159 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-902c2851-8309-4c13-943d-dcc5b056116b tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:41.869821 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-902c2851-8309-4c13-943d-dcc5b056116b tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:41.870807 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-902c2851-8309-4c13-943d-dcc5b056116b tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:41.871862 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-902c2851-8309-4c13-943d-dcc5b056116b tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:41.872528 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-902c2851-8309-4c13-943d-dcc5b056116b tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:41.902731 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell1:SELECT=100 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:41.907441 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-c1f2a4de-6434-447f-b003-9c014c821bdf tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:41.908053 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-c1f2a4de-6434-447f-b003-9c014c821bdf tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 1329e8e9-9358-454d-bea3-dad19dfc53da] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:41.919824 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c1f2a4de-6434-447f-b003-9c014c821bdf tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:41.920334 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c1f2a4de-6434-447f-b003-9c014c821bdf tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:41.920927 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c1f2a4de-6434-447f-b003-9c014c821bdf tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:41.921775 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c1f2a4de-6434-447f-b003-9c014c821bdf tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:41.922219 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c1f2a4de-6434-447f-b003-9c014c821bdf tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:41.922638 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c1f2a4de-6434-447f-b003-9c014c821bdf tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:42.410747 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-c1f2a4de-6434-447f-b003-9c014c821bdf tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:42.426187 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-c1f2a4de-6434-447f-b003-9c014c821bdf tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da" status: 200 len: 1557 microversion: 2.1 time: 0.522583 Aug 09 11:18:42.428945 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 55/111] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:41 2022] GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da => generated 1557 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:18:42.433923 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-251c0e1b-f5d4-48c9-93a1-da2a562919ff tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1766226122", "imageRef": "2321e9a0-fe0f-47fd-9c4b-8868eb5a00af", "flavorRef": "452", "networks": [{"uuid": "b186ad16-42dd-42cc-9160-e6aad8baa604"}]}} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:18:42.544975 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.network.neutron [None req-251c0e1b-f5d4-48c9-93a1-da2a562919ff tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] validate_networks() for [('b186ad16-42dd-42cc-9160-e6aad8baa604', None, None, None, None, None)] {{(pid=117685) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 11:18:42.568774 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-902c2851-8309-4c13-943d-dcc5b056116b tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] 10.222.0.27 "POST /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.725086 Aug 09 11:18:42.574973 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 57/112] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Aug 9 11:18:41 2022] POST /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654/os-volume_attachments => generated 194 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:18:42.580916 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [req-818719cb-ca34-4e0a-85bc-0ec5a70fc7a2 req-0b525494-f82f-49fc-9873-d8558597685b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69542c8c-90b6-49a4-aed3-c229168f215f", "tag": "e9e1072a-3971-440e-9a60-ba15e5db60f3"}]} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:18:42.598124 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-818719cb-ca34-4e0a-85bc-0ec5a70fc7a2 req-0b525494-f82f-49fc-9873-d8558597685b service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:42.598683 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-818719cb-ca34-4e0a-85bc-0ec5a70fc7a2 req-0b525494-f82f-49fc-9873-d8558597685b service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:42.599115 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-818719cb-ca34-4e0a-85bc-0ec5a70fc7a2 req-0b525494-f82f-49fc-9873-d8558597685b service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:42.615347 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.compute.server_external_events [req-818719cb-ca34-4e0a-85bc-0ec5a70fc7a2 req-0b525494-f82f-49fc-9873-d8558597685b service nova] Creating event network-changed:e9e1072a-3971-440e-9a60-ba15e5db60f3 for instance 69542c8c-90b6-49a4-aed3-c229168f215f on hv-cinder-85251 Aug 09 11:18:42.620774 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [req-818719cb-ca34-4e0a-85bc-0ec5a70fc7a2 req-0b525494-f82f-49fc-9873-d8558597685b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049627 Aug 09 11:18:42.621764 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 58/113] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:18:42.627891 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-e6d3455c-26b5-4f25-a041-b4dd0076c218 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:42.628865 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-e6d3455c-26b5-4f25-a041-b4dd0076c218 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 1329e8e9-9358-454d-bea3-dad19dfc53da] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:42.636589 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e6d3455c-26b5-4f25-a041-b4dd0076c218 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:42.637340 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e6d3455c-26b5-4f25-a041-b4dd0076c218 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:42.637848 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e6d3455c-26b5-4f25-a041-b4dd0076c218 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:42.638712 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e6d3455c-26b5-4f25-a041-b4dd0076c218 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:42.639261 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e6d3455c-26b5-4f25-a041-b4dd0076c218 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:42.639761 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e6d3455c-26b5-4f25-a041-b4dd0076c218 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:42.925960 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-e6d3455c-26b5-4f25-a041-b4dd0076c218 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.302837 Aug 09 11:18:42.926631 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 59/114] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Aug 9 11:18:42 2022] GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da/os-interface => generated 284 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:18:43.292760 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-251c0e1b-f5d4-48c9-93a1-da2a562919ff tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Flavor limits 0:0:0 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 11:18:43.295026 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-251c0e1b-f5d4-48c9-93a1-da2a562919ff tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Image limits 0:0:0 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 11:18:43.295602 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-251c0e1b-f5d4-48c9-93a1-da2a562919ff tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Flavor pref 0:0:0 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 11:18:43.296209 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-251c0e1b-f5d4-48c9-93a1-da2a562919ff tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Image pref 0:0:0 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 11:18:43.296880 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-251c0e1b-f5d4-48c9-93a1-da2a562919ff tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 11:18:43.307327 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-251c0e1b-f5d4-48c9-93a1-da2a562919ff tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:43.308131 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-251c0e1b-f5d4-48c9-93a1-da2a562919ff tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:43.308787 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-251c0e1b-f5d4-48c9-93a1-da2a562919ff tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:43.309732 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-251c0e1b-f5d4-48c9-93a1-da2a562919ff tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:43.310375 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-251c0e1b-f5d4-48c9-93a1-da2a562919ff tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:43.310992 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-251c0e1b-f5d4-48c9-93a1-da2a562919ff tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:43.331720 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.quota [None req-251c0e1b-f5d4-48c9-93a1-da2a562919ff tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Getting quotas for project b37fc7dacc11483ca9c6f047d3bd2553. Resources: {'cores', 'instances', 'ram'} {{(pid=117685) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:18:43.336794 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.quota [None req-251c0e1b-f5d4-48c9-93a1-da2a562919ff tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Getting quotas for user b3c011df2b144f758dd286e77875bcc8 and project b37fc7dacc11483ca9c6f047d3bd2553. Resources: {'cores', 'instances', 'ram'} {{(pid=117685) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:18:43.350640 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-251c0e1b-f5d4-48c9-93a1-da2a562919ff tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Going to run 1 instances... {{(pid=117685) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 11:18:43.357653 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-251c0e1b-f5d4-48c9-93a1-da2a562919ff tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] [instance: 5649e5ff-fbc3-41b1-be08-7546eea1115f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2321e9a0-fe0f-47fd-9c4b-8868eb5a00af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117685) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 11:18:43.372852 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:43.446176 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-251c0e1b-f5d4-48c9-93a1-da2a562919ff tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.012466 Aug 09 11:18:43.447082 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 56/115] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 9 11:18:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 11:18:43.458306 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-6e139a53-2939-42a3-9f91-77ba6103106a tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:43.459046 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-6e139a53-2939-42a3-9f91-77ba6103106a tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] [instance: 5649e5ff-fbc3-41b1-be08-7546eea1115f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:43.545345 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-6e139a53-2939-42a3-9f91-77ba6103106a tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c011df2b144f758dd286e77875bcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37fc7dacc11483ca9c6f047d3bd2553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:43.554242 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-6e139a53-2939-42a3-9f91-77ba6103106a tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] 10.222.0.27 "GET /compute/v2.1/servers/5649e5ff-fbc3-41b1-be08-7546eea1115f" status: 200 len: 1214 microversion: 2.1 time: 0.100145 Aug 09 11:18:43.554815 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 60/116] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:43 2022] GET /compute/v2.1/servers/5649e5ff-fbc3-41b1-be08-7546eea1115f => generated 1214 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:44.577234 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-c247767b-0d42-4501-83fd-ce40b517685f tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:44.578662 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-c247767b-0d42-4501-83fd-ce40b517685f tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] [instance: 5649e5ff-fbc3-41b1-be08-7546eea1115f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:44.586213 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c247767b-0d42-4501-83fd-ce40b517685f tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:44.587415 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c247767b-0d42-4501-83fd-ce40b517685f tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:44.588043 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c247767b-0d42-4501-83fd-ce40b517685f tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:44.589182 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c247767b-0d42-4501-83fd-ce40b517685f tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:44.589786 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c247767b-0d42-4501-83fd-ce40b517685f tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:44.590354 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c247767b-0d42-4501-83fd-ce40b517685f tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:44.676825 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [req-bbae880a-77d2-45f3-af12-30293d3ae269 req-fc2757c9-be77-4ea1-8e03-02b1c8a2c827 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1329e8e9-9358-454d-bea3-dad19dfc53da", "tag": "b3947c96-3346-4577-96e3-f0591b58e37f"}]} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:18:44.683303 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-c247767b-0d42-4501-83fd-ce40b517685f tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c011df2b144f758dd286e77875bcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37fc7dacc11483ca9c6f047d3bd2553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:44.693282 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-c247767b-0d42-4501-83fd-ce40b517685f tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] 10.222.0.27 "GET /compute/v2.1/servers/5649e5ff-fbc3-41b1-be08-7546eea1115f" status: 200 len: 1218 microversion: 2.1 time: 0.120564 Aug 09 11:18:44.694576 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 57/117] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:44 2022] GET /compute/v2.1/servers/5649e5ff-fbc3-41b1-be08-7546eea1115f => generated 1218 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:44.701449 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-bbae880a-77d2-45f3-af12-30293d3ae269 req-fc2757c9-be77-4ea1-8e03-02b1c8a2c827 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:44.702193 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-bbae880a-77d2-45f3-af12-30293d3ae269 req-fc2757c9-be77-4ea1-8e03-02b1c8a2c827 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:44.703735 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-bbae880a-77d2-45f3-af12-30293d3ae269 req-fc2757c9-be77-4ea1-8e03-02b1c8a2c827 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:44.717284 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.compute.server_external_events [req-bbae880a-77d2-45f3-af12-30293d3ae269 req-fc2757c9-be77-4ea1-8e03-02b1c8a2c827 service nova] Creating event network-changed:b3947c96-3346-4577-96e3-f0591b58e37f for instance 1329e8e9-9358-454d-bea3-dad19dfc53da on hv-cinder-85251 Aug 09 11:18:44.724616 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [req-bbae880a-77d2-45f3-af12-30293d3ae269 req-fc2757c9-be77-4ea1-8e03-02b1c8a2c827 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051378 Aug 09 11:18:44.726062 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 61/118] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:18:45.723667 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-9561f252-b820-4ef5-980f-6c7b8bc65ce8 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:45.725196 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-9561f252-b820-4ef5-980f-6c7b8bc65ce8 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] [instance: 5649e5ff-fbc3-41b1-be08-7546eea1115f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:45.771777 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9561f252-b820-4ef5-980f-6c7b8bc65ce8 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:45.776118 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9561f252-b820-4ef5-980f-6c7b8bc65ce8 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:45.779209 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9561f252-b820-4ef5-980f-6c7b8bc65ce8 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:45.780392 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9561f252-b820-4ef5-980f-6c7b8bc65ce8 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:45.782060 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9561f252-b820-4ef5-980f-6c7b8bc65ce8 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:45.782631 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9561f252-b820-4ef5-980f-6c7b8bc65ce8 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:45.963667 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-9561f252-b820-4ef5-980f-6c7b8bc65ce8 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c011df2b144f758dd286e77875bcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37fc7dacc11483ca9c6f047d3bd2553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:45.978066 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-9561f252-b820-4ef5-980f-6c7b8bc65ce8 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] 10.222.0.27 "GET /compute/v2.1/servers/5649e5ff-fbc3-41b1-be08-7546eea1115f" status: 200 len: 1210 microversion: 2.1 time: 0.266118 Aug 09 11:18:45.979455 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 58/119] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:45 2022] GET /compute/v2.1/servers/5649e5ff-fbc3-41b1-be08-7546eea1115f => generated 1210 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:47.008036 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-94dae0db-d02b-4cd2-894f-1c6857861cb3 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:47.010443 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-94dae0db-d02b-4cd2-894f-1c6857861cb3 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] [instance: 5649e5ff-fbc3-41b1-be08-7546eea1115f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:47.030760 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-94dae0db-d02b-4cd2-894f-1c6857861cb3 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:47.031422 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-94dae0db-d02b-4cd2-894f-1c6857861cb3 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:47.032049 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-94dae0db-d02b-4cd2-894f-1c6857861cb3 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:47.032853 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-94dae0db-d02b-4cd2-894f-1c6857861cb3 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:47.033447 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-94dae0db-d02b-4cd2-894f-1c6857861cb3 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:47.033909 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-94dae0db-d02b-4cd2-894f-1c6857861cb3 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:47.355483 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-94dae0db-d02b-4cd2-894f-1c6857861cb3 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c011df2b144f758dd286e77875bcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37fc7dacc11483ca9c6f047d3bd2553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:47.367669 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-94dae0db-d02b-4cd2-894f-1c6857861cb3 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] 10.222.0.27 "GET /compute/v2.1/servers/5649e5ff-fbc3-41b1-be08-7546eea1115f" status: 200 len: 1272 microversion: 2.1 time: 0.372050 Aug 09 11:18:47.382992 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 62/120] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:46 2022] GET /compute/v2.1/servers/5649e5ff-fbc3-41b1-be08-7546eea1115f => generated 1272 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:48.089036 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-29f0c21e-3f83-4e1e-b6dd-bbb49cb7207f req-23c895b4-0e21-42b5-bc12-647fb1fd1118 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5649e5ff-fbc3-41b1-be08-7546eea1115f", "tag": "ab6cf532-9f0c-4206-b8be-c5aaec8ea5e5"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:18:48.107694 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-29f0c21e-3f83-4e1e-b6dd-bbb49cb7207f req-23c895b4-0e21-42b5-bc12-647fb1fd1118 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:48.108177 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-29f0c21e-3f83-4e1e-b6dd-bbb49cb7207f req-23c895b4-0e21-42b5-bc12-647fb1fd1118 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:48.108957 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-29f0c21e-3f83-4e1e-b6dd-bbb49cb7207f req-23c895b4-0e21-42b5-bc12-647fb1fd1118 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:48.123076 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-29f0c21e-3f83-4e1e-b6dd-bbb49cb7207f req-23c895b4-0e21-42b5-bc12-647fb1fd1118 service nova] Creating event network-changed:ab6cf532-9f0c-4206-b8be-c5aaec8ea5e5 for instance 5649e5ff-fbc3-41b1-be08-7546eea1115f on hv-cinder-85251 Aug 09 11:18:48.130220 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-29f0c21e-3f83-4e1e-b6dd-bbb49cb7207f req-23c895b4-0e21-42b5-bc12-647fb1fd1118 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050697 Aug 09 11:18:48.131149 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 59/121] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:18:48.391169 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-40b2806e-ef6e-451b-a075-847d681a0951 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:48.391831 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-40b2806e-ef6e-451b-a075-847d681a0951 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] [instance: 5649e5ff-fbc3-41b1-be08-7546eea1115f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:48.398471 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-40b2806e-ef6e-451b-a075-847d681a0951 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:48.399150 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-40b2806e-ef6e-451b-a075-847d681a0951 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:48.399642 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-40b2806e-ef6e-451b-a075-847d681a0951 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:48.400455 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-40b2806e-ef6e-451b-a075-847d681a0951 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:48.400915 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-40b2806e-ef6e-451b-a075-847d681a0951 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:48.401748 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-40b2806e-ef6e-451b-a075-847d681a0951 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:48.567316 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-40b2806e-ef6e-451b-a075-847d681a0951 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c011df2b144f758dd286e77875bcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37fc7dacc11483ca9c6f047d3bd2553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:48.577003 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-40b2806e-ef6e-451b-a075-847d681a0951 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] 10.222.0.27 "GET /compute/v2.1/servers/5649e5ff-fbc3-41b1-be08-7546eea1115f" status: 200 len: 1314 microversion: 2.1 time: 0.189873 Aug 09 11:18:48.578300 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 63/122] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:48 2022] GET /compute/v2.1/servers/5649e5ff-fbc3-41b1-be08-7546eea1115f => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:48.795733 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-bbca72f3-d901-4ec3-98e2-f238bf0eb7be tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-281418181", "imageRef": "2321e9a0-fe0f-47fd-9c4b-8868eb5a00af", "flavorRef": "452"}} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:18:48.845945 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.network.neutron [None req-bbca72f3-d901-4ec3-98e2-f238bf0eb7be tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] validate_networks() for None {{(pid=117685) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 11:18:49.136099 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-bbca72f3-d901-4ec3-98e2-f238bf0eb7be tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Flavor limits 0:0:0 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 11:18:49.136730 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-bbca72f3-d901-4ec3-98e2-f238bf0eb7be tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Image limits 0:0:0 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 11:18:49.136995 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-bbca72f3-d901-4ec3-98e2-f238bf0eb7be tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Flavor pref 0:0:0 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 11:18:49.137398 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-bbca72f3-d901-4ec3-98e2-f238bf0eb7be tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Image pref 0:0:0 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 11:18:49.137805 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-bbca72f3-d901-4ec3-98e2-f238bf0eb7be tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 11:18:49.147118 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bbca72f3-d901-4ec3-98e2-f238bf0eb7be tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:49.147595 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bbca72f3-d901-4ec3-98e2-f238bf0eb7be tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:49.148019 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bbca72f3-d901-4ec3-98e2-f238bf0eb7be tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:49.148776 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bbca72f3-d901-4ec3-98e2-f238bf0eb7be tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:49.149224 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bbca72f3-d901-4ec3-98e2-f238bf0eb7be tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:49.149636 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bbca72f3-d901-4ec3-98e2-f238bf0eb7be tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:49.166752 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.quota [None req-bbca72f3-d901-4ec3-98e2-f238bf0eb7be tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Getting quotas for project 0df8bd6fe9ca418d9e295aa3f419f5de. Resources: {'cores', 'instances', 'ram'} {{(pid=117685) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:18:49.171189 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.quota [None req-bbca72f3-d901-4ec3-98e2-f238bf0eb7be tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Getting quotas for user 87689334264c4a939367f091ccfbd642 and project 0df8bd6fe9ca418d9e295aa3f419f5de. Resources: {'cores', 'instances', 'ram'} {{(pid=117685) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:18:49.185652 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-bbca72f3-d901-4ec3-98e2-f238bf0eb7be tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Going to run 1 instances... {{(pid=117685) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 11:18:49.188147 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-bbca72f3-d901-4ec3-98e2-f238bf0eb7be tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] [instance: b52e58fe-0ca0-47f5-9824-8edd6509d2ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2321e9a0-fe0f-47fd-9c4b-8868eb5a00af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117685) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 11:18:49.235049 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-bbca72f3-d901-4ec3-98e2-f238bf0eb7be tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.444638 Aug 09 11:18:49.235694 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 60/123] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 9 11:18:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 446 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 11:18:49.246795 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-9fb79db4-f339-4d14-b588-7ce3282e7e68 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:49.247400 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-9fb79db4-f339-4d14-b588-7ce3282e7e68 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] [instance: b52e58fe-0ca0-47f5-9824-8edd6509d2ee] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:49.305758 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-9fb79db4-f339-4d14-b588-7ce3282e7e68 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87689334264c4a939367f091ccfbd642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8bd6fe9ca418d9e295aa3f419f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:49.312819 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-9fb79db4-f339-4d14-b588-7ce3282e7e68 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] 10.222.0.27 "GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee" status: 200 len: 1214 microversion: 2.1 time: 0.070151 Aug 09 11:18:49.313356 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 64/124] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:49 2022] GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:18:49.599135 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-22de93d8-6977-44c0-82ee-1e161ff2e539 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:49.599734 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-22de93d8-6977-44c0-82ee-1e161ff2e539 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] [instance: 5649e5ff-fbc3-41b1-be08-7546eea1115f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:49.606612 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-22de93d8-6977-44c0-82ee-1e161ff2e539 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:49.607101 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-22de93d8-6977-44c0-82ee-1e161ff2e539 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:49.607536 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-22de93d8-6977-44c0-82ee-1e161ff2e539 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:49.608230 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-22de93d8-6977-44c0-82ee-1e161ff2e539 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:49.608880 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-22de93d8-6977-44c0-82ee-1e161ff2e539 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:49.609351 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-22de93d8-6977-44c0-82ee-1e161ff2e539 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:49.745130 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-22de93d8-6977-44c0-82ee-1e161ff2e539 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c011df2b144f758dd286e77875bcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37fc7dacc11483ca9c6f047d3bd2553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:49.753324 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-22de93d8-6977-44c0-82ee-1e161ff2e539 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] 10.222.0.27 "GET /compute/v2.1/servers/5649e5ff-fbc3-41b1-be08-7546eea1115f" status: 200 len: 1314 microversion: 2.1 time: 0.158102 Aug 09 11:18:49.753926 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 61/125] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:49 2022] GET /compute/v2.1/servers/5649e5ff-fbc3-41b1-be08-7546eea1115f => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:50.333789 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-82676bc9-6e25-4c4f-beb5-41c6b84de31d tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:50.334444 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-82676bc9-6e25-4c4f-beb5-41c6b84de31d tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] [instance: b52e58fe-0ca0-47f5-9824-8edd6509d2ee] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:50.342065 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-82676bc9-6e25-4c4f-beb5-41c6b84de31d tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:50.342542 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-82676bc9-6e25-4c4f-beb5-41c6b84de31d tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:50.342996 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-82676bc9-6e25-4c4f-beb5-41c6b84de31d tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:50.343688 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-82676bc9-6e25-4c4f-beb5-41c6b84de31d tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:50.344129 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-82676bc9-6e25-4c4f-beb5-41c6b84de31d tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:50.344578 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-82676bc9-6e25-4c4f-beb5-41c6b84de31d tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:50.413863 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-82676bc9-6e25-4c4f-beb5-41c6b84de31d tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87689334264c4a939367f091ccfbd642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8bd6fe9ca418d9e295aa3f419f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:50.422102 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-82676bc9-6e25-4c4f-beb5-41c6b84de31d tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] 10.222.0.27 "GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee" status: 200 len: 1218 microversion: 2.1 time: 0.092359 Aug 09 11:18:50.422700 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 65/126] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:50 2022] GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:50.775350 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-bf62610f-1055-43c6-9078-e71b574bcec5 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:50.775949 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-bf62610f-1055-43c6-9078-e71b574bcec5 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] [instance: 5649e5ff-fbc3-41b1-be08-7546eea1115f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:50.782645 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bf62610f-1055-43c6-9078-e71b574bcec5 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:50.783136 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bf62610f-1055-43c6-9078-e71b574bcec5 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:50.783552 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bf62610f-1055-43c6-9078-e71b574bcec5 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:50.784221 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bf62610f-1055-43c6-9078-e71b574bcec5 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:50.784695 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bf62610f-1055-43c6-9078-e71b574bcec5 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:50.785102 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bf62610f-1055-43c6-9078-e71b574bcec5 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:50.927743 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-bf62610f-1055-43c6-9078-e71b574bcec5 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c011df2b144f758dd286e77875bcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37fc7dacc11483ca9c6f047d3bd2553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:50.935893 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-bf62610f-1055-43c6-9078-e71b574bcec5 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] 10.222.0.27 "GET /compute/v2.1/servers/5649e5ff-fbc3-41b1-be08-7546eea1115f" status: 200 len: 1314 microversion: 2.1 time: 0.164540 Aug 09 11:18:50.936493 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 62/127] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:50 2022] GET /compute/v2.1/servers/5649e5ff-fbc3-41b1-be08-7546eea1115f => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:51.448629 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-f7a5301e-6228-4eab-a6f1-c1e0cf3c7148 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:51.449928 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-f7a5301e-6228-4eab-a6f1-c1e0cf3c7148 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] [instance: b52e58fe-0ca0-47f5-9824-8edd6509d2ee] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:51.456990 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f7a5301e-6228-4eab-a6f1-c1e0cf3c7148 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:51.457469 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f7a5301e-6228-4eab-a6f1-c1e0cf3c7148 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:51.457896 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f7a5301e-6228-4eab-a6f1-c1e0cf3c7148 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:51.458589 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f7a5301e-6228-4eab-a6f1-c1e0cf3c7148 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:51.459031 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f7a5301e-6228-4eab-a6f1-c1e0cf3c7148 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:51.459450 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f7a5301e-6228-4eab-a6f1-c1e0cf3c7148 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:51.522921 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-f7a5301e-6228-4eab-a6f1-c1e0cf3c7148 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87689334264c4a939367f091ccfbd642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8bd6fe9ca418d9e295aa3f419f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:51.531347 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-f7a5301e-6228-4eab-a6f1-c1e0cf3c7148 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] 10.222.0.27 "GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee" status: 200 len: 1218 microversion: 2.1 time: 0.089328 Aug 09 11:18:51.531504 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 66/128] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:51 2022] GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:51.956497 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-07d1c905-a469-47a2-979f-d24ea0b9b1c3 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:51.957102 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-07d1c905-a469-47a2-979f-d24ea0b9b1c3 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] [instance: 5649e5ff-fbc3-41b1-be08-7546eea1115f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:51.963575 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-07d1c905-a469-47a2-979f-d24ea0b9b1c3 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:51.964133 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-07d1c905-a469-47a2-979f-d24ea0b9b1c3 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:51.964568 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-07d1c905-a469-47a2-979f-d24ea0b9b1c3 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:51.965285 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-07d1c905-a469-47a2-979f-d24ea0b9b1c3 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:51.965727 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-07d1c905-a469-47a2-979f-d24ea0b9b1c3 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:51.966143 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-07d1c905-a469-47a2-979f-d24ea0b9b1c3 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:52.097480 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-07d1c905-a469-47a2-979f-d24ea0b9b1c3 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c011df2b144f758dd286e77875bcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37fc7dacc11483ca9c6f047d3bd2553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:52.105196 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-07d1c905-a469-47a2-979f-d24ea0b9b1c3 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] 10.222.0.27 "GET /compute/v2.1/servers/5649e5ff-fbc3-41b1-be08-7546eea1115f" status: 200 len: 1314 microversion: 2.1 time: 0.152626 Aug 09 11:18:52.106088 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 63/129] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:51 2022] GET /compute/v2.1/servers/5649e5ff-fbc3-41b1-be08-7546eea1115f => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:52.553509 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-7778adf2-f93d-4170-b4b2-d3371f491cac tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:52.554153 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-7778adf2-f93d-4170-b4b2-d3371f491cac tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] [instance: b52e58fe-0ca0-47f5-9824-8edd6509d2ee] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:52.556709 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_api:SELECT=74 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:52.562215 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7778adf2-f93d-4170-b4b2-d3371f491cac tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:52.562687 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7778adf2-f93d-4170-b4b2-d3371f491cac tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:52.563118 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7778adf2-f93d-4170-b4b2-d3371f491cac tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:52.563805 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7778adf2-f93d-4170-b4b2-d3371f491cac tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:52.564251 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7778adf2-f93d-4170-b4b2-d3371f491cac tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:52.564691 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7778adf2-f93d-4170-b4b2-d3371f491cac tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:52.627475 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-7778adf2-f93d-4170-b4b2-d3371f491cac tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87689334264c4a939367f091ccfbd642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8bd6fe9ca418d9e295aa3f419f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:52.635632 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-7778adf2-f93d-4170-b4b2-d3371f491cac tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] 10.222.0.27 "GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee" status: 200 len: 1218 microversion: 2.1 time: 0.086048 Aug 09 11:18:52.636546 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 67/130] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:52 2022] GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:53.127333 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-5a38a851-edb9-4bcc-ac87-8441945f6474 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:53.128048 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-5a38a851-edb9-4bcc-ac87-8441945f6474 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] [instance: 5649e5ff-fbc3-41b1-be08-7546eea1115f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:53.135778 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5a38a851-edb9-4bcc-ac87-8441945f6474 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:53.136259 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5a38a851-edb9-4bcc-ac87-8441945f6474 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:53.136886 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5a38a851-edb9-4bcc-ac87-8441945f6474 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:53.137674 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5a38a851-edb9-4bcc-ac87-8441945f6474 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:53.138185 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5a38a851-edb9-4bcc-ac87-8441945f6474 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:53.138547 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5a38a851-edb9-4bcc-ac87-8441945f6474 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:53.275897 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-5a38a851-edb9-4bcc-ac87-8441945f6474 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c011df2b144f758dd286e77875bcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37fc7dacc11483ca9c6f047d3bd2553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:53.283562 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-5a38a851-edb9-4bcc-ac87-8441945f6474 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] 10.222.0.27 "GET /compute/v2.1/servers/5649e5ff-fbc3-41b1-be08-7546eea1115f" status: 200 len: 1314 microversion: 2.1 time: 0.160861 Aug 09 11:18:53.284157 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 64/131] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:53 2022] GET /compute/v2.1/servers/5649e5ff-fbc3-41b1-be08-7546eea1115f => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:53.656373 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-471eca42-f020-4526-b9ff-f7797391cabb tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:53.657076 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-471eca42-f020-4526-b9ff-f7797391cabb tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] [instance: b52e58fe-0ca0-47f5-9824-8edd6509d2ee] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:53.663775 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-471eca42-f020-4526-b9ff-f7797391cabb tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:53.664293 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-471eca42-f020-4526-b9ff-f7797391cabb tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:53.664707 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-471eca42-f020-4526-b9ff-f7797391cabb tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:53.665393 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-471eca42-f020-4526-b9ff-f7797391cabb tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:53.665837 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-471eca42-f020-4526-b9ff-f7797391cabb tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:53.666321 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-471eca42-f020-4526-b9ff-f7797391cabb tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:53.727057 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-471eca42-f020-4526-b9ff-f7797391cabb tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87689334264c4a939367f091ccfbd642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8bd6fe9ca418d9e295aa3f419f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:53.735052 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-471eca42-f020-4526-b9ff-f7797391cabb tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] 10.222.0.27 "GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee" status: 200 len: 1218 microversion: 2.1 time: 0.082542 Aug 09 11:18:53.735672 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 68/132] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:53 2022] GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:54.306310 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-11658266-210f-45e4-beb2-52021c9ea9c5 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:54.307186 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-11658266-210f-45e4-beb2-52021c9ea9c5 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] [instance: 5649e5ff-fbc3-41b1-be08-7546eea1115f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:54.320240 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-11658266-210f-45e4-beb2-52021c9ea9c5 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:54.320818 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-11658266-210f-45e4-beb2-52021c9ea9c5 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:54.321271 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-11658266-210f-45e4-beb2-52021c9ea9c5 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:54.322010 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-11658266-210f-45e4-beb2-52021c9ea9c5 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:54.322482 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-11658266-210f-45e4-beb2-52021c9ea9c5 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:54.322948 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-11658266-210f-45e4-beb2-52021c9ea9c5 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:54.491253 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-11658266-210f-45e4-beb2-52021c9ea9c5 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c011df2b144f758dd286e77875bcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37fc7dacc11483ca9c6f047d3bd2553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:54.499723 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-11658266-210f-45e4-beb2-52021c9ea9c5 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] 10.222.0.27 "GET /compute/v2.1/servers/5649e5ff-fbc3-41b1-be08-7546eea1115f" status: 200 len: 1314 microversion: 2.1 time: 0.197005 Aug 09 11:18:54.500387 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 65/133] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:54 2022] GET /compute/v2.1/servers/5649e5ff-fbc3-41b1-be08-7546eea1115f => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:54.762970 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-09dede70-b3e9-413e-a9cc-de043beae8fa tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:54.763801 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-09dede70-b3e9-413e-a9cc-de043beae8fa tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] [instance: b52e58fe-0ca0-47f5-9824-8edd6509d2ee] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:54.773089 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-09dede70-b3e9-413e-a9cc-de043beae8fa tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:54.773574 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-09dede70-b3e9-413e-a9cc-de043beae8fa tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:54.773995 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-09dede70-b3e9-413e-a9cc-de043beae8fa tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:54.774948 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-09dede70-b3e9-413e-a9cc-de043beae8fa tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:54.775576 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-09dede70-b3e9-413e-a9cc-de043beae8fa tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:54.776038 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-09dede70-b3e9-413e-a9cc-de043beae8fa tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:54.848870 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-09dede70-b3e9-413e-a9cc-de043beae8fa tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87689334264c4a939367f091ccfbd642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8bd6fe9ca418d9e295aa3f419f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:54.857368 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-09dede70-b3e9-413e-a9cc-de043beae8fa tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] 10.222.0.27 "GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee" status: 200 len: 1218 microversion: 2.1 time: 0.099534 Aug 09 11:18:54.858690 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 69/134] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:54 2022] GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee => generated 1218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:55.522073 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-c03f2dc1-eec7-4741-8dc3-842e5c7460cc tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:55.522660 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-c03f2dc1-eec7-4741-8dc3-842e5c7460cc tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] [instance: 5649e5ff-fbc3-41b1-be08-7546eea1115f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:55.529174 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c03f2dc1-eec7-4741-8dc3-842e5c7460cc tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:55.529583 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c03f2dc1-eec7-4741-8dc3-842e5c7460cc tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:55.530001 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c03f2dc1-eec7-4741-8dc3-842e5c7460cc tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:55.530672 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c03f2dc1-eec7-4741-8dc3-842e5c7460cc tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:55.531114 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c03f2dc1-eec7-4741-8dc3-842e5c7460cc tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:55.531523 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c03f2dc1-eec7-4741-8dc3-842e5c7460cc tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:55.664441 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-c03f2dc1-eec7-4741-8dc3-842e5c7460cc tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c011df2b144f758dd286e77875bcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37fc7dacc11483ca9c6f047d3bd2553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:55.672004 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-c03f2dc1-eec7-4741-8dc3-842e5c7460cc tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] 10.222.0.27 "GET /compute/v2.1/servers/5649e5ff-fbc3-41b1-be08-7546eea1115f" status: 200 len: 1314 microversion: 2.1 time: 0.153733 Aug 09 11:18:55.672635 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 66/135] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:55 2022] GET /compute/v2.1/servers/5649e5ff-fbc3-41b1-be08-7546eea1115f => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:55.880255 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-a64b95f4-82f1-447c-a020-050b5a467b44 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:55.880811 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-a64b95f4-82f1-447c-a020-050b5a467b44 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] [instance: b52e58fe-0ca0-47f5-9824-8edd6509d2ee] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:55.889501 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a64b95f4-82f1-447c-a020-050b5a467b44 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:55.890068 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a64b95f4-82f1-447c-a020-050b5a467b44 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:55.890508 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a64b95f4-82f1-447c-a020-050b5a467b44 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:55.891226 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a64b95f4-82f1-447c-a020-050b5a467b44 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:55.891725 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a64b95f4-82f1-447c-a020-050b5a467b44 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:55.892195 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a64b95f4-82f1-447c-a020-050b5a467b44 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:55.954760 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-a64b95f4-82f1-447c-a020-050b5a467b44 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87689334264c4a939367f091ccfbd642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8bd6fe9ca418d9e295aa3f419f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:55.962693 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-a64b95f4-82f1-447c-a020-050b5a467b44 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] 10.222.0.27 "GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee" status: 200 len: 1210 microversion: 2.1 time: 0.086508 Aug 09 11:18:55.963265 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 70/136] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:55 2022] GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee => generated 1210 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:56.693022 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-bf40af02-0af1-426b-b130-2160721ac7e8 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:56.693545 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-bf40af02-0af1-426b-b130-2160721ac7e8 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] [instance: 5649e5ff-fbc3-41b1-be08-7546eea1115f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:56.700027 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bf40af02-0af1-426b-b130-2160721ac7e8 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:56.700542 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bf40af02-0af1-426b-b130-2160721ac7e8 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:56.701537 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bf40af02-0af1-426b-b130-2160721ac7e8 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:56.702225 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bf40af02-0af1-426b-b130-2160721ac7e8 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:56.702673 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bf40af02-0af1-426b-b130-2160721ac7e8 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:56.703090 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bf40af02-0af1-426b-b130-2160721ac7e8 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:56.850989 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-bf40af02-0af1-426b-b130-2160721ac7e8 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c011df2b144f758dd286e77875bcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37fc7dacc11483ca9c6f047d3bd2553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:56.859785 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-bf40af02-0af1-426b-b130-2160721ac7e8 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] 10.222.0.27 "GET /compute/v2.1/servers/5649e5ff-fbc3-41b1-be08-7546eea1115f" status: 200 len: 1314 microversion: 2.1 time: 0.170527 Aug 09 11:18:56.860550 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 67/137] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:56 2022] GET /compute/v2.1/servers/5649e5ff-fbc3-41b1-be08-7546eea1115f => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:56.986541 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-a02f1d3c-d138-4237-b75a-a31101125208 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:56.987148 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-a02f1d3c-d138-4237-b75a-a31101125208 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] [instance: b52e58fe-0ca0-47f5-9824-8edd6509d2ee] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:56.993340 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a02f1d3c-d138-4237-b75a-a31101125208 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:56.993816 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a02f1d3c-d138-4237-b75a-a31101125208 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:56.994272 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a02f1d3c-d138-4237-b75a-a31101125208 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:56.994952 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a02f1d3c-d138-4237-b75a-a31101125208 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:56.995399 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a02f1d3c-d138-4237-b75a-a31101125208 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:56.995847 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a02f1d3c-d138-4237-b75a-a31101125208 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:57.060933 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-a02f1d3c-d138-4237-b75a-a31101125208 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87689334264c4a939367f091ccfbd642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8bd6fe9ca418d9e295aa3f419f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:57.068502 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-a02f1d3c-d138-4237-b75a-a31101125208 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] 10.222.0.27 "GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee" status: 200 len: 1210 microversion: 2.1 time: 0.086473 Aug 09 11:18:57.069069 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 71/138] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:56 2022] GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee => generated 1210 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:57.884510 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-bb367784-91ce-4e06-bcab-409cac3d3dc6 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:57.885127 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-bb367784-91ce-4e06-bcab-409cac3d3dc6 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] [instance: 5649e5ff-fbc3-41b1-be08-7546eea1115f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:57.892162 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bb367784-91ce-4e06-bcab-409cac3d3dc6 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:57.892668 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bb367784-91ce-4e06-bcab-409cac3d3dc6 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:57.893099 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bb367784-91ce-4e06-bcab-409cac3d3dc6 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:57.893779 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bb367784-91ce-4e06-bcab-409cac3d3dc6 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:57.894224 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bb367784-91ce-4e06-bcab-409cac3d3dc6 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:57.894637 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bb367784-91ce-4e06-bcab-409cac3d3dc6 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:58.035111 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-bb367784-91ce-4e06-bcab-409cac3d3dc6 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c011df2b144f758dd286e77875bcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37fc7dacc11483ca9c6f047d3bd2553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:58.042922 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-bb367784-91ce-4e06-bcab-409cac3d3dc6 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] 10.222.0.27 "GET /compute/v2.1/servers/5649e5ff-fbc3-41b1-be08-7546eea1115f" status: 200 len: 1314 microversion: 2.1 time: 0.162715 Aug 09 11:18:58.043486 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 68/139] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:57 2022] GET /compute/v2.1/servers/5649e5ff-fbc3-41b1-be08-7546eea1115f => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:58.090706 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-c8b1061f-17df-4934-85d7-d0cc4aa8e407 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:58.091320 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-c8b1061f-17df-4934-85d7-d0cc4aa8e407 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] [instance: b52e58fe-0ca0-47f5-9824-8edd6509d2ee] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:58.098355 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c8b1061f-17df-4934-85d7-d0cc4aa8e407 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:58.098827 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c8b1061f-17df-4934-85d7-d0cc4aa8e407 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:58.099254 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c8b1061f-17df-4934-85d7-d0cc4aa8e407 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:58.099941 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c8b1061f-17df-4934-85d7-d0cc4aa8e407 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:58.100415 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c8b1061f-17df-4934-85d7-d0cc4aa8e407 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:58.100836 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c8b1061f-17df-4934-85d7-d0cc4aa8e407 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:58.168098 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-c8b1061f-17df-4934-85d7-d0cc4aa8e407 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87689334264c4a939367f091ccfbd642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8bd6fe9ca418d9e295aa3f419f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:58.176061 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-c8b1061f-17df-4934-85d7-d0cc4aa8e407 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] 10.222.0.27 "GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee" status: 200 len: 1210 microversion: 2.1 time: 0.089875 Aug 09 11:18:58.176758 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 72/140] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:58 2022] GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee => generated 1210 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:59.064051 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-4db93f1a-7b1e-40f1-aff7-2327b93bff95 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:59.064675 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-4db93f1a-7b1e-40f1-aff7-2327b93bff95 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] [instance: 5649e5ff-fbc3-41b1-be08-7546eea1115f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:59.073433 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4db93f1a-7b1e-40f1-aff7-2327b93bff95 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:59.073914 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4db93f1a-7b1e-40f1-aff7-2327b93bff95 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:59.074343 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4db93f1a-7b1e-40f1-aff7-2327b93bff95 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:59.075034 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4db93f1a-7b1e-40f1-aff7-2327b93bff95 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:59.075480 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4db93f1a-7b1e-40f1-aff7-2327b93bff95 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:59.075900 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4db93f1a-7b1e-40f1-aff7-2327b93bff95 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:59.095637 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell1:SELECT=100 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:59.156147 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell0:SELECT=4 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:59.180809 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell0:SELECT=12 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:59.200703 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-98760835-5b52-45c4-9d03-9a64daefac39 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:59.201396 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-98760835-5b52-45c4-9d03-9a64daefac39 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] [instance: b52e58fe-0ca0-47f5-9824-8edd6509d2ee] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:59.212843 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-98760835-5b52-45c4-9d03-9a64daefac39 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:59.213610 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-98760835-5b52-45c4-9d03-9a64daefac39 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:59.214044 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-98760835-5b52-45c4-9d03-9a64daefac39 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:59.214915 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-98760835-5b52-45c4-9d03-9a64daefac39 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:59.215328 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-98760835-5b52-45c4-9d03-9a64daefac39 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:59.215873 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-98760835-5b52-45c4-9d03-9a64daefac39 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:59.219264 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-4db93f1a-7b1e-40f1-aff7-2327b93bff95 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c011df2b144f758dd286e77875bcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37fc7dacc11483ca9c6f047d3bd2553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:59.233356 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-4db93f1a-7b1e-40f1-aff7-2327b93bff95 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] 10.222.0.27 "GET /compute/v2.1/servers/5649e5ff-fbc3-41b1-be08-7546eea1115f" status: 200 len: 1314 microversion: 2.1 time: 0.173056 Aug 09 11:18:59.233964 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 69/141] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:59 2022] GET /compute/v2.1/servers/5649e5ff-fbc3-41b1-be08-7546eea1115f => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:59.308167 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-98760835-5b52-45c4-9d03-9a64daefac39 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87689334264c4a939367f091ccfbd642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8bd6fe9ca418d9e295aa3f419f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:18:59.311381 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell0:SELECT=4 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:59.333023 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-98760835-5b52-45c4-9d03-9a64daefac39 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] 10.222.0.27 "GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee" status: 200 len: 1210 microversion: 2.1 time: 0.136573 Aug 09 11:18:59.348407 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 73/142] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:18:59 2022] GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee => generated 1210 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:59.916420 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-8a5e56ac-01dd-4fc9-8e36-6f212495d05c tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:59.917182 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-8a5e56ac-01dd-4fc9-8e36-6f212495d05c tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] [instance: 629b5a40-87b1-42c3-91c7-5731966c0654] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:18:59.925073 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8a5e56ac-01dd-4fc9-8e36-6f212495d05c tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:59.927905 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8a5e56ac-01dd-4fc9-8e36-6f212495d05c tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:59.928588 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8a5e56ac-01dd-4fc9-8e36-6f212495d05c tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:59.929450 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8a5e56ac-01dd-4fc9-8e36-6f212495d05c tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:18:59.930041 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8a5e56ac-01dd-4fc9-8e36-6f212495d05c tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:18:59.930593 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8a5e56ac-01dd-4fc9-8e36-6f212495d05c tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:18:59.958552 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-8a5e56ac-01dd-4fc9-8e36-6f212495d05c tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] [instance: 629b5a40-87b1-42c3-91c7-5731966c0654] Going to try to terminate instance {{(pid=117685) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 11:19:00.066102 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-8a5e56ac-01dd-4fc9-8e36-6f212495d05c tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] 10.222.0.27 "DELETE /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654" status: 204 len: 0 microversion: 2.1 time: 0.153470 Aug 09 11:19:00.067707 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 70/143] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 9 11:18:59 2022] DELETE /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 11:19:00.077586 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-ac7c41a8-145c-4de4-a271-8dbba281ad98 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:00.078814 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-ac7c41a8-145c-4de4-a271-8dbba281ad98 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] [instance: 629b5a40-87b1-42c3-91c7-5731966c0654] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:00.086966 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ac7c41a8-145c-4de4-a271-8dbba281ad98 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:00.087596 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ac7c41a8-145c-4de4-a271-8dbba281ad98 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:00.088133 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ac7c41a8-145c-4de4-a271-8dbba281ad98 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:00.088919 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ac7c41a8-145c-4de4-a271-8dbba281ad98 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:00.089447 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ac7c41a8-145c-4de4-a271-8dbba281ad98 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:00.089941 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ac7c41a8-145c-4de4-a271-8dbba281ad98 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:00.234301 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-ac7c41a8-145c-4de4-a271-8dbba281ad98 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c8a0130c8e42c5b4a6ffe43d15865e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8459b14a54824536b415b2b7336389df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:00.243012 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-ac7c41a8-145c-4de4-a271-8dbba281ad98 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] 10.222.0.27 "GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654" status: 200 len: 1553 microversion: 2.1 time: 0.170279 Aug 09 11:19:00.243577 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 74/144] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:00 2022] GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654 => generated 1553 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:00.255110 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-b1317fa9-cda7-49ab-88e8-6d98680610dc tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:00.255823 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-b1317fa9-cda7-49ab-88e8-6d98680610dc tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] [instance: 5649e5ff-fbc3-41b1-be08-7546eea1115f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:00.263035 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b1317fa9-cda7-49ab-88e8-6d98680610dc tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:00.263586 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b1317fa9-cda7-49ab-88e8-6d98680610dc tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:00.264208 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b1317fa9-cda7-49ab-88e8-6d98680610dc tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:00.264712 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b1317fa9-cda7-49ab-88e8-6d98680610dc tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:00.265147 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b1317fa9-cda7-49ab-88e8-6d98680610dc tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:00.265560 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b1317fa9-cda7-49ab-88e8-6d98680610dc tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:00.354612 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-313cec31-fe4c-44b9-92b2-011963290e28 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:00.355456 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-313cec31-fe4c-44b9-92b2-011963290e28 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] [instance: b52e58fe-0ca0-47f5-9824-8edd6509d2ee] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:00.361918 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-313cec31-fe4c-44b9-92b2-011963290e28 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:00.362716 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-313cec31-fe4c-44b9-92b2-011963290e28 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:00.363180 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-313cec31-fe4c-44b9-92b2-011963290e28 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:00.364046 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-313cec31-fe4c-44b9-92b2-011963290e28 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:00.364523 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-313cec31-fe4c-44b9-92b2-011963290e28 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:00.364977 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-313cec31-fe4c-44b9-92b2-011963290e28 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:00.405585 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-b1317fa9-cda7-49ab-88e8-6d98680610dc tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c011df2b144f758dd286e77875bcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37fc7dacc11483ca9c6f047d3bd2553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:00.414302 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-b1317fa9-cda7-49ab-88e8-6d98680610dc tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] 10.222.0.27 "GET /compute/v2.1/servers/5649e5ff-fbc3-41b1-be08-7546eea1115f" status: 200 len: 1314 microversion: 2.1 time: 0.163333 Aug 09 11:19:00.415262 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 71/145] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:00 2022] GET /compute/v2.1/servers/5649e5ff-fbc3-41b1-be08-7546eea1115f => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:00.437117 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-313cec31-fe4c-44b9-92b2-011963290e28 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87689334264c4a939367f091ccfbd642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8bd6fe9ca418d9e295aa3f419f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:00.444500 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-313cec31-fe4c-44b9-92b2-011963290e28 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] 10.222.0.27 "GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee" status: 200 len: 1266 microversion: 2.1 time: 0.093765 Aug 09 11:19:00.445088 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 75/146] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:00 2022] GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:01.264190 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-394d4f5a-f6e3-40ff-8379-c6a43b1a4d23 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:01.264807 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-394d4f5a-f6e3-40ff-8379-c6a43b1a4d23 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] [instance: 629b5a40-87b1-42c3-91c7-5731966c0654] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:01.271406 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-394d4f5a-f6e3-40ff-8379-c6a43b1a4d23 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:01.272038 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-394d4f5a-f6e3-40ff-8379-c6a43b1a4d23 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:01.272528 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-394d4f5a-f6e3-40ff-8379-c6a43b1a4d23 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:01.273230 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-394d4f5a-f6e3-40ff-8379-c6a43b1a4d23 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:01.273750 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-394d4f5a-f6e3-40ff-8379-c6a43b1a4d23 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:01.274258 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-394d4f5a-f6e3-40ff-8379-c6a43b1a4d23 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:01.409450 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [req-5b7f8339-b000-4bcd-82a9-1da2c51b2e75 req-f54f51d1-8b3d-4375-8ca7-86be38fb199c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5649e5ff-fbc3-41b1-be08-7546eea1115f", "name": "network-vif-plugged", "status": "completed", "tag": "ab6cf532-9f0c-4206-b8be-c5aaec8ea5e5"}]} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:19:01.412812 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-394d4f5a-f6e3-40ff-8379-c6a43b1a4d23 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c8a0130c8e42c5b4a6ffe43d15865e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8459b14a54824536b415b2b7336389df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:01.420904 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-394d4f5a-f6e3-40ff-8379-c6a43b1a4d23 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] 10.222.0.27 "GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654" status: 200 len: 1553 microversion: 2.1 time: 0.161088 Aug 09 11:19:01.421157 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-5b7f8339-b000-4bcd-82a9-1da2c51b2e75 req-f54f51d1-8b3d-4375-8ca7-86be38fb199c service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:01.421739 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-5b7f8339-b000-4bcd-82a9-1da2c51b2e75 req-f54f51d1-8b3d-4375-8ca7-86be38fb199c service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:01.422001 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 72/147] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:01 2022] GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654 => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:19:01.422344 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-5b7f8339-b000-4bcd-82a9-1da2c51b2e75 req-f54f51d1-8b3d-4375-8ca7-86be38fb199c service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:01.434844 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.compute.server_external_events [req-5b7f8339-b000-4bcd-82a9-1da2c51b2e75 req-f54f51d1-8b3d-4375-8ca7-86be38fb199c service nova] Creating event network-vif-plugged:ab6cf532-9f0c-4206-b8be-c5aaec8ea5e5 for instance 5649e5ff-fbc3-41b1-be08-7546eea1115f on hv-cinder-85251 Aug 09 11:19:01.439892 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-e6ec9039-9b10-48e8-8eef-f81cbff42307 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:01.440655 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-e6ec9039-9b10-48e8-8eef-f81cbff42307 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] [instance: 5649e5ff-fbc3-41b1-be08-7546eea1115f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:01.441146 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [req-5b7f8339-b000-4bcd-82a9-1da2c51b2e75 req-f54f51d1-8b3d-4375-8ca7-86be38fb199c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036737 Aug 09 11:19:01.441855 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 76/148] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:19:01.446453 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e6ec9039-9b10-48e8-8eef-f81cbff42307 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:01.446995 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e6ec9039-9b10-48e8-8eef-f81cbff42307 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:01.447411 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e6ec9039-9b10-48e8-8eef-f81cbff42307 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:01.448260 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e6ec9039-9b10-48e8-8eef-f81cbff42307 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:01.448741 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e6ec9039-9b10-48e8-8eef-f81cbff42307 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:01.449180 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e6ec9039-9b10-48e8-8eef-f81cbff42307 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:01.465760 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-1661b508-53bd-41c1-b197-415ffc0aea7a tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:01.466481 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-1661b508-53bd-41c1-b197-415ffc0aea7a tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] [instance: b52e58fe-0ca0-47f5-9824-8edd6509d2ee] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:01.473735 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1661b508-53bd-41c1-b197-415ffc0aea7a tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:01.474210 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1661b508-53bd-41c1-b197-415ffc0aea7a tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:01.474639 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1661b508-53bd-41c1-b197-415ffc0aea7a tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:01.475327 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1661b508-53bd-41c1-b197-415ffc0aea7a tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:01.475772 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1661b508-53bd-41c1-b197-415ffc0aea7a tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:01.476185 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1661b508-53bd-41c1-b197-415ffc0aea7a tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:01.481021 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:01.552230 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-1661b508-53bd-41c1-b197-415ffc0aea7a tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87689334264c4a939367f091ccfbd642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8bd6fe9ca418d9e295aa3f419f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:01.560166 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-1661b508-53bd-41c1-b197-415ffc0aea7a tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] 10.222.0.27 "GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee" status: 200 len: 1266 microversion: 2.1 time: 0.098595 Aug 09 11:19:01.561132 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 77/149] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:01 2022] GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee => generated 1266 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:19:01.624818 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-e6ec9039-9b10-48e8-8eef-f81cbff42307 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c011df2b144f758dd286e77875bcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37fc7dacc11483ca9c6f047d3bd2553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:01.632799 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-e6ec9039-9b10-48e8-8eef-f81cbff42307 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] 10.222.0.27 "GET /compute/v2.1/servers/5649e5ff-fbc3-41b1-be08-7546eea1115f" status: 200 len: 1314 microversion: 2.1 time: 0.201344 Aug 09 11:19:01.633467 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 73/150] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:01 2022] GET /compute/v2.1/servers/5649e5ff-fbc3-41b1-be08-7546eea1115f => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:02.451905 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-c2bcd1f1-80f2-4805-aac4-3f677eab6335 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:02.453304 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-c2bcd1f1-80f2-4805-aac4-3f677eab6335 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] [instance: 629b5a40-87b1-42c3-91c7-5731966c0654] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:02.461429 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c2bcd1f1-80f2-4805-aac4-3f677eab6335 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:02.461915 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c2bcd1f1-80f2-4805-aac4-3f677eab6335 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:02.462347 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c2bcd1f1-80f2-4805-aac4-3f677eab6335 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:02.463094 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c2bcd1f1-80f2-4805-aac4-3f677eab6335 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:02.463537 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c2bcd1f1-80f2-4805-aac4-3f677eab6335 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:02.463980 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c2bcd1f1-80f2-4805-aac4-3f677eab6335 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:02.580577 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-9339707f-8523-4854-be8f-5849895d8d8e tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:02.588472 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-9339707f-8523-4854-be8f-5849895d8d8e tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] [instance: b52e58fe-0ca0-47f5-9824-8edd6509d2ee] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:02.606269 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9339707f-8523-4854-be8f-5849895d8d8e tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:02.606763 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9339707f-8523-4854-be8f-5849895d8d8e tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:02.607211 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9339707f-8523-4854-be8f-5849895d8d8e tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:02.607891 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9339707f-8523-4854-be8f-5849895d8d8e tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:02.608359 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9339707f-8523-4854-be8f-5849895d8d8e tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:02.608787 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9339707f-8523-4854-be8f-5849895d8d8e tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:02.623143 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-c2bcd1f1-80f2-4805-aac4-3f677eab6335 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c8a0130c8e42c5b4a6ffe43d15865e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8459b14a54824536b415b2b7336389df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:02.632637 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-c2bcd1f1-80f2-4805-aac4-3f677eab6335 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] 10.222.0.27 "GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654" status: 200 len: 1553 microversion: 2.1 time: 0.189769 Aug 09 11:19:02.633549 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 78/151] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:02 2022] GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654 => generated 1553 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:02.654129 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-efaf8b08-99cf-4154-beed-1ff2f4b8102b tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:02.654971 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-efaf8b08-99cf-4154-beed-1ff2f4b8102b tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] [instance: 5649e5ff-fbc3-41b1-be08-7546eea1115f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:02.662814 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-efaf8b08-99cf-4154-beed-1ff2f4b8102b tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:02.663625 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-efaf8b08-99cf-4154-beed-1ff2f4b8102b tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:02.664258 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-efaf8b08-99cf-4154-beed-1ff2f4b8102b tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:02.665201 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-efaf8b08-99cf-4154-beed-1ff2f4b8102b tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:02.665896 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-efaf8b08-99cf-4154-beed-1ff2f4b8102b tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:02.666513 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-efaf8b08-99cf-4154-beed-1ff2f4b8102b tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:02.710014 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-9339707f-8523-4854-be8f-5849895d8d8e tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87689334264c4a939367f091ccfbd642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8bd6fe9ca418d9e295aa3f419f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:02.718551 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-9339707f-8523-4854-be8f-5849895d8d8e tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] 10.222.0.27 "GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee" status: 200 len: 1266 microversion: 2.1 time: 0.141908 Aug 09 11:19:02.719138 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 74/152] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:02 2022] GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:02.812581 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-efaf8b08-99cf-4154-beed-1ff2f4b8102b tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c011df2b144f758dd286e77875bcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37fc7dacc11483ca9c6f047d3bd2553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:02.820156 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-efaf8b08-99cf-4154-beed-1ff2f4b8102b tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] 10.222.0.27 "GET /compute/v2.1/servers/5649e5ff-fbc3-41b1-be08-7546eea1115f" status: 200 len: 1314 microversion: 2.1 time: 0.170189 Aug 09 11:19:02.820938 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 79/153] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:02 2022] GET /compute/v2.1/servers/5649e5ff-fbc3-41b1-be08-7546eea1115f => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:19:03.663432 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-9a99b820-ce0c-4f74-b112-2a48c81c82a0 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:03.664205 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-9a99b820-ce0c-4f74-b112-2a48c81c82a0 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] [instance: 629b5a40-87b1-42c3-91c7-5731966c0654] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:03.670289 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9a99b820-ce0c-4f74-b112-2a48c81c82a0 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:03.670924 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9a99b820-ce0c-4f74-b112-2a48c81c82a0 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:03.671355 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9a99b820-ce0c-4f74-b112-2a48c81c82a0 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:03.672222 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9a99b820-ce0c-4f74-b112-2a48c81c82a0 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:03.672842 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9a99b820-ce0c-4f74-b112-2a48c81c82a0 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:03.673256 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9a99b820-ce0c-4f74-b112-2a48c81c82a0 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:03.741527 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-006fe994-891a-4484-9fb8-a3bb9e5c1077 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:03.742202 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-006fe994-891a-4484-9fb8-a3bb9e5c1077 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] [instance: b52e58fe-0ca0-47f5-9824-8edd6509d2ee] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:03.748961 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-006fe994-891a-4484-9fb8-a3bb9e5c1077 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:03.749501 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-006fe994-891a-4484-9fb8-a3bb9e5c1077 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:03.749883 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-006fe994-891a-4484-9fb8-a3bb9e5c1077 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:03.750536 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-006fe994-891a-4484-9fb8-a3bb9e5c1077 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:03.751164 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-006fe994-891a-4484-9fb8-a3bb9e5c1077 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:03.751767 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-006fe994-891a-4484-9fb8-a3bb9e5c1077 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:03.822945 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-006fe994-891a-4484-9fb8-a3bb9e5c1077 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87689334264c4a939367f091ccfbd642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8bd6fe9ca418d9e295aa3f419f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:03.833556 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-006fe994-891a-4484-9fb8-a3bb9e5c1077 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] 10.222.0.27 "GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee" status: 200 len: 1272 microversion: 2.1 time: 0.096852 Aug 09 11:19:03.835164 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 80/154] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:03 2022] GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee => generated 1272 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:19:03.840709 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-aba23368-e759-4654-bc17-eabe4adf106a tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:03.841580 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-aba23368-e759-4654-bc17-eabe4adf106a tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] [instance: 5649e5ff-fbc3-41b1-be08-7546eea1115f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:03.848241 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-aba23368-e759-4654-bc17-eabe4adf106a tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:03.849102 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-aba23368-e759-4654-bc17-eabe4adf106a tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:03.849730 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-aba23368-e759-4654-bc17-eabe4adf106a tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:03.850634 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-aba23368-e759-4654-bc17-eabe4adf106a tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:03.851326 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-aba23368-e759-4654-bc17-eabe4adf106a tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:03.851940 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-aba23368-e759-4654-bc17-eabe4adf106a tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:03.855829 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-9a99b820-ce0c-4f74-b112-2a48c81c82a0 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c8a0130c8e42c5b4a6ffe43d15865e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8459b14a54824536b415b2b7336389df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:03.865149 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-9a99b820-ce0c-4f74-b112-2a48c81c82a0 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] 10.222.0.27 "GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654" status: 200 len: 1553 microversion: 2.1 time: 0.206790 Aug 09 11:19:03.872791 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 75/155] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:03 2022] GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654 => generated 1553 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:04.002006 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-aba23368-e759-4654-bc17-eabe4adf106a tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c011df2b144f758dd286e77875bcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37fc7dacc11483ca9c6f047d3bd2553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:04.015509 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-aba23368-e759-4654-bc17-eabe4adf106a tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] 10.222.0.27 "GET /compute/v2.1/servers/5649e5ff-fbc3-41b1-be08-7546eea1115f" status: 200 len: 1314 microversion: 2.1 time: 0.178679 Aug 09 11:19:04.016529 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 81/156] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:03 2022] GET /compute/v2.1/servers/5649e5ff-fbc3-41b1-be08-7546eea1115f => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:04.242212 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-bc71c015-a97c-458c-a988-1abbfd3ed5a5 req-ff0f5acd-81bc-4bb4-81e4-76676c339495 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "629b5a40-87b1-42c3-91c7-5731966c0654", "name": "network-vif-deleted", "tag": "2af6391a-f3a9-41ef-8789-72d123f8468e"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:19:04.254452 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-bc71c015-a97c-458c-a988-1abbfd3ed5a5 req-ff0f5acd-81bc-4bb4-81e4-76676c339495 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:04.255670 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-bc71c015-a97c-458c-a988-1abbfd3ed5a5 req-ff0f5acd-81bc-4bb4-81e4-76676c339495 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:04.256339 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-bc71c015-a97c-458c-a988-1abbfd3ed5a5 req-ff0f5acd-81bc-4bb4-81e4-76676c339495 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:04.275168 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-bc71c015-a97c-458c-a988-1abbfd3ed5a5 req-ff0f5acd-81bc-4bb4-81e4-76676c339495 service nova] Creating event network-vif-deleted:2af6391a-f3a9-41ef-8789-72d123f8468e for instance 629b5a40-87b1-42c3-91c7-5731966c0654 on hv-cinder-85251 Aug 09 11:19:04.285409 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-bc71c015-a97c-458c-a988-1abbfd3ed5a5 req-ff0f5acd-81bc-4bb4-81e4-76676c339495 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045496 Aug 09 11:19:04.287837 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 76/157] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:19:04.856961 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-1b75762f-026f-4452-837b-88ac5dfb7634 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:04.857587 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-1b75762f-026f-4452-837b-88ac5dfb7634 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] [instance: b52e58fe-0ca0-47f5-9824-8edd6509d2ee] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:04.868467 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1b75762f-026f-4452-837b-88ac5dfb7634 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:04.868467 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1b75762f-026f-4452-837b-88ac5dfb7634 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:04.868911 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1b75762f-026f-4452-837b-88ac5dfb7634 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:04.870455 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1b75762f-026f-4452-837b-88ac5dfb7634 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:04.870875 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1b75762f-026f-4452-837b-88ac5dfb7634 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:04.871480 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1b75762f-026f-4452-837b-88ac5dfb7634 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:04.888871 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-ffbb6ebe-a8fc-4217-b3e7-4fcbb8496fa8 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:04.889631 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-ffbb6ebe-a8fc-4217-b3e7-4fcbb8496fa8 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] [instance: 629b5a40-87b1-42c3-91c7-5731966c0654] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:04.901004 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ffbb6ebe-a8fc-4217-b3e7-4fcbb8496fa8 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:04.902211 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ffbb6ebe-a8fc-4217-b3e7-4fcbb8496fa8 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:04.903059 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ffbb6ebe-a8fc-4217-b3e7-4fcbb8496fa8 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:04.904155 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ffbb6ebe-a8fc-4217-b3e7-4fcbb8496fa8 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:04.905219 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ffbb6ebe-a8fc-4217-b3e7-4fcbb8496fa8 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:04.906506 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ffbb6ebe-a8fc-4217-b3e7-4fcbb8496fa8 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:05.036416 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-ffbb6ebe-a8fc-4217-b3e7-4fcbb8496fa8 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c8a0130c8e42c5b4a6ffe43d15865e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8459b14a54824536b415b2b7336389df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:05.057999 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-ffbb6ebe-a8fc-4217-b3e7-4fcbb8496fa8 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] 10.222.0.27 "GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654" status: 200 len: 1345 microversion: 2.1 time: 0.175096 Aug 09 11:19:05.059174 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 77/158] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:04 2022] GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654 => generated 1345 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:05.073763 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-2d807943-7ac0-477e-8a28-f91d67557f10 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:05.075562 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-2d807943-7ac0-477e-8a28-f91d67557f10 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] [instance: 5649e5ff-fbc3-41b1-be08-7546eea1115f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:05.083831 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2d807943-7ac0-477e-8a28-f91d67557f10 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:05.084806 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2d807943-7ac0-477e-8a28-f91d67557f10 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:05.085550 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2d807943-7ac0-477e-8a28-f91d67557f10 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:05.086394 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2d807943-7ac0-477e-8a28-f91d67557f10 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:05.087060 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2d807943-7ac0-477e-8a28-f91d67557f10 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:05.087457 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2d807943-7ac0-477e-8a28-f91d67557f10 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:05.102275 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-1b75762f-026f-4452-837b-88ac5dfb7634 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87689334264c4a939367f091ccfbd642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8bd6fe9ca418d9e295aa3f419f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:05.115022 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-1b75762f-026f-4452-837b-88ac5dfb7634 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] 10.222.0.27 "GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee" status: 200 len: 1314 microversion: 2.1 time: 0.258549 Aug 09 11:19:05.119567 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 82/159] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:04 2022] GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:05.271467 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-2d807943-7ac0-477e-8a28-f91d67557f10 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c011df2b144f758dd286e77875bcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37fc7dacc11483ca9c6f047d3bd2553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:05.284625 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-2d807943-7ac0-477e-8a28-f91d67557f10 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] 10.222.0.27 "GET /compute/v2.1/servers/5649e5ff-fbc3-41b1-be08-7546eea1115f" status: 200 len: 1498 microversion: 2.1 time: 0.215157 Aug 09 11:19:05.285779 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 78/160] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:05 2022] GET /compute/v2.1/servers/5649e5ff-fbc3-41b1-be08-7546eea1115f => generated 1498 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:05.868701 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-16888a8c-be0b-464a-a3c1-b16116229a10 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:05.869178 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-16888a8c-be0b-464a-a3c1-b16116229a10 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] [instance: 5649e5ff-fbc3-41b1-be08-7546eea1115f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:05.879101 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-16888a8c-be0b-464a-a3c1-b16116229a10 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:05.879566 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-16888a8c-be0b-464a-a3c1-b16116229a10 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:05.880022 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-16888a8c-be0b-464a-a3c1-b16116229a10 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:05.880851 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-16888a8c-be0b-464a-a3c1-b16116229a10 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:05.881289 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-16888a8c-be0b-464a-a3c1-b16116229a10 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:05.881759 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-16888a8c-be0b-464a-a3c1-b16116229a10 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:05.917090 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-16888a8c-be0b-464a-a3c1-b16116229a10 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] [instance: 5649e5ff-fbc3-41b1-be08-7546eea1115f] Going to try to terminate instance {{(pid=117684) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 11:19:06.079316 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-0148dced-9b27-4c31-8751-b138811434f5 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:06.081445 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-0148dced-9b27-4c31-8751-b138811434f5 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] [instance: 629b5a40-87b1-42c3-91c7-5731966c0654] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:06.092414 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0148dced-9b27-4c31-8751-b138811434f5 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:06.093071 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0148dced-9b27-4c31-8751-b138811434f5 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:06.095120 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0148dced-9b27-4c31-8751-b138811434f5 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:06.095998 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0148dced-9b27-4c31-8751-b138811434f5 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:06.098180 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0148dced-9b27-4c31-8751-b138811434f5 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:06.099178 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0148dced-9b27-4c31-8751-b138811434f5 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:06.106334 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-16888a8c-be0b-464a-a3c1-b16116229a10 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5649e5ff-fbc3-41b1-be08-7546eea1115f" status: 204 len: 0 microversion: 2.1 time: 0.241330 Aug 09 11:19:06.106984 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 83/161] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 9 11:19:05 2022] DELETE /compute/v2.1/servers/5649e5ff-fbc3-41b1-be08-7546eea1115f => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 11:19:06.122105 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.wsgi [None req-0148dced-9b27-4c31-8751-b138811434f5 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] HTTP exception thrown: Instance 629b5a40-87b1-42c3-91c7-5731966c0654 could not be found. Aug 09 11:19:06.127355 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-0148dced-9b27-4c31-8751-b138811434f5 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Request method failure captured: Aug 09 11:19:06.127355 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: request: GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654 HTTP/1.1 Aug 09 11:19:06.127355 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Accept: application/json Aug 09 11:19:06.127355 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Accept-Encoding: identity Aug 09 11:19:06.127355 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Connection: close Aug 09 11:19:06.127355 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Content-Length: 0 Aug 09 11:19:06.127355 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Content-Type: application/json Aug 09 11:19:06.127355 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Host: 10.222.0.27 Aug 09 11:19:06.127355 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Openstack-System-Scope: None Aug 09 11:19:06.127355 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: User-Agent: python-urllib3/1.26.11 Aug 09 11:19:06.127355 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Auth-Token: gAAAAABi8kJpRrt7HOih2AefZ54OLsTXZPEX0zaLTC8d2ShyfVCdvjU8ptQfB0EOf3dAGS5b8vxoPyVvcqLLSnkFilZAJNerJq2ZJzaDpEB6a0tdP9wvYYYfwZMu4KVEFPOxt4ZxchsH30IVavh_4JdjcatwXH-DD3hPwljAG4OfeAaaLrOJEXw Aug 09 11:19:06.127355 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Domain-Id: None Aug 09 11:19:06.127355 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Domain-Name: None Aug 09 11:19:06.127355 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Identity-Status: Confirmed Aug 09 11:19:06.127355 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Is-Admin-Project: True Aug 09 11:19:06.127355 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Domain-Id: default Aug 09 11:19:06.127355 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Domain-Name: Default Aug 09 11:19:06.127355 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Id: 8459b14a54824536b415b2b7336389df Aug 09 11:19:06.127355 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Name: tempest-DeleteServersTestJSON-745875447 Aug 09 11:19:06.127355 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Role: member,reader Aug 09 11:19:06.127355 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Roles: member,reader Aug 09 11:19:06.128657 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8459b14a54824536b415b2b7336389df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8459b14a54824536b415b2b7336389df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8459b14a54824536b415b2b7336389df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8459b14a54824536b415b2b7336389df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:19:06.128657 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant: tempest-DeleteServersTestJSON-745875447 Aug 09 11:19:06.128657 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant-Id: 8459b14a54824536b415b2b7336389df Aug 09 11:19:06.128657 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant-Name: tempest-DeleteServersTestJSON-745875447 Aug 09 11:19:06.128657 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User: tempest-DeleteServersTestJSON-745875447-project Aug 09 11:19:06.128657 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Domain-Id: default Aug 09 11:19:06.128657 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Domain-Name: Default Aug 09 11:19:06.128657 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Id: 69c8a0130c8e42c5b4a6ffe43d15865e Aug 09 11:19:06.128657 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Name: tempest-DeleteServersTestJSON-745875447-project Aug 09 11:19:06.128657 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: method: > Aug 09 11:19:06.128657 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: exception: Instance 629b5a40-87b1-42c3-91c7-5731966c0654 could not be found. Aug 09 11:19:06.128657 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: action_args: {'id': '629b5a40-87b1-42c3-91c7-5731966c0654'} Aug 09 11:19:06.129434 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:19:06.129434 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:19:06.129434 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:19:06.129434 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:19:06.129434 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:19:06.129434 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:19:06.129434 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:19:06.129434 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:19:06.129434 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:19:06.129434 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:19:06.129434 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 629b5a40-87b1-42c3-91c7-5731966c0654 could not be found. Aug 09 11:19:06.129434 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:19:06.129434 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:19:06.129434 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:19:06.129434 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:19:06.129434 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:19:06.129434 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:19:06.129434 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:19:06.129434 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:19:06.129434 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:19:06.130523 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:19:06.130523 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:19:06.130523 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:19:06.130523 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:19:06.130523 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:19:06.130523 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:19:06.130523 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:19:06.130523 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 629b5a40-87b1-42c3-91c7-5731966c0654 could not be found. Aug 09 11:19:06.130523 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:19:06.130523 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:19:06.130523 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:19:06.130523 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:19:06.130523 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:19:06.130523 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:19:06.130523 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:19:06.130523 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:19:06.130523 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 629b5a40-87b1-42c3-91c7-5731966c0654 could not be found. Aug 09 11:19:06.130523 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:19:06.132226 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-562a9430-2a83-4c79-849d-9f4c0db6bb56 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:06.132550 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-562a9430-2a83-4c79-849d-9f4c0db6bb56 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] [instance: 5649e5ff-fbc3-41b1-be08-7546eea1115f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:06.133759 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-0148dced-9b27-4c31-8751-b138811434f5 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Returning 404 to user: Instance 629b5a40-87b1-42c3-91c7-5731966c0654 could not be found. {{(pid=117685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:19:06.135286 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-0148dced-9b27-4c31-8751-b138811434f5 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] 10.222.0.27 "GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654" status: 404 len: 111 microversion: 2.1 time: 0.060227 Aug 09 11:19:06.136065 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 79/162] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:06 2022] GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 11:19:06.141227 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-20d93072-4771-424f-b416-dad1633ecf14 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:06.142036 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-20d93072-4771-424f-b416-dad1633ecf14 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] [instance: b52e58fe-0ca0-47f5-9824-8edd6509d2ee] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:06.147895 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-562a9430-2a83-4c79-849d-9f4c0db6bb56 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:06.148410 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-562a9430-2a83-4c79-849d-9f4c0db6bb56 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:06.148855 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-562a9430-2a83-4c79-849d-9f4c0db6bb56 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:06.149562 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-562a9430-2a83-4c79-849d-9f4c0db6bb56 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:06.151677 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-562a9430-2a83-4c79-849d-9f4c0db6bb56 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:06.152298 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-562a9430-2a83-4c79-849d-9f4c0db6bb56 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:06.161342 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-20d93072-4771-424f-b416-dad1633ecf14 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:06.165147 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-20d93072-4771-424f-b416-dad1633ecf14 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:06.165623 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-20d93072-4771-424f-b416-dad1633ecf14 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:06.168193 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-20d93072-4771-424f-b416-dad1633ecf14 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:06.168834 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-20d93072-4771-424f-b416-dad1633ecf14 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:06.169984 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-20d93072-4771-424f-b416-dad1633ecf14 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:06.386580 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-562a9430-2a83-4c79-849d-9f4c0db6bb56 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c011df2b144f758dd286e77875bcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37fc7dacc11483ca9c6f047d3bd2553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:06.393835 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-20d93072-4771-424f-b416-dad1633ecf14 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87689334264c4a939367f091ccfbd642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8bd6fe9ca418d9e295aa3f419f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:06.397147 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-562a9430-2a83-4c79-849d-9f4c0db6bb56 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] 10.222.0.27 "GET /compute/v2.1/servers/5649e5ff-fbc3-41b1-be08-7546eea1115f" status: 200 len: 1504 microversion: 2.1 time: 0.283505 Aug 09 11:19:06.397889 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 84/163] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:06 2022] GET /compute/v2.1/servers/5649e5ff-fbc3-41b1-be08-7546eea1115f => generated 1504 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:06.402884 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-f107bac5-7fab-4363-9ec9-8a366b603814 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:06.412843 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-20d93072-4771-424f-b416-dad1633ecf14 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] 10.222.0.27 "GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee" status: 200 len: 1314 microversion: 2.1 time: 0.273759 Aug 09 11:19:06.416504 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 80/164] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:06 2022] GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:06.418575 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-f107bac5-7fab-4363-9ec9-8a366b603814 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] [instance: 629b5a40-87b1-42c3-91c7-5731966c0654] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:06.422513 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-d9484d5a-fb15-4875-82f8-53e85bd33460 req-f7ae996e-223c-43d1-8dae-27453147d682 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b52e58fe-0ca0-47f5-9824-8edd6509d2ee", "tag": "a0e1df8f-6c5d-403e-b534-35078a35e14f"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:19:06.430001 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f107bac5-7fab-4363-9ec9-8a366b603814 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:06.430498 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f107bac5-7fab-4363-9ec9-8a366b603814 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:06.431123 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f107bac5-7fab-4363-9ec9-8a366b603814 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:06.431771 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f107bac5-7fab-4363-9ec9-8a366b603814 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:06.432226 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f107bac5-7fab-4363-9ec9-8a366b603814 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:06.432666 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f107bac5-7fab-4363-9ec9-8a366b603814 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:06.441649 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-d9484d5a-fb15-4875-82f8-53e85bd33460 req-f7ae996e-223c-43d1-8dae-27453147d682 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:06.442124 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-d9484d5a-fb15-4875-82f8-53e85bd33460 req-f7ae996e-223c-43d1-8dae-27453147d682 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:06.442544 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-d9484d5a-fb15-4875-82f8-53e85bd33460 req-f7ae996e-223c-43d1-8dae-27453147d682 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:06.450024 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.wsgi [None req-f107bac5-7fab-4363-9ec9-8a366b603814 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] HTTP exception thrown: Instance 629b5a40-87b1-42c3-91c7-5731966c0654 could not be found. Aug 09 11:19:06.454344 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-f107bac5-7fab-4363-9ec9-8a366b603814 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Request method failure captured: Aug 09 11:19:06.454344 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: request: GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654/os-volume_attachments HTTP/1.1 Aug 09 11:19:06.454344 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept: application/json Aug 09 11:19:06.454344 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept-Encoding: identity Aug 09 11:19:06.454344 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Connection: close Aug 09 11:19:06.454344 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Length: 0 Aug 09 11:19:06.454344 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Type: application/json Aug 09 11:19:06.454344 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Host: 10.222.0.27 Aug 09 11:19:06.454344 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Openstack-System-Scope: None Aug 09 11:19:06.454344 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: User-Agent: python-urllib3/1.26.11 Aug 09 11:19:06.454344 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Auth-Token: gAAAAABi8kJpRrt7HOih2AefZ54OLsTXZPEX0zaLTC8d2ShyfVCdvjU8ptQfB0EOf3dAGS5b8vxoPyVvcqLLSnkFilZAJNerJq2ZJzaDpEB6a0tdP9wvYYYfwZMu4KVEFPOxt4ZxchsH30IVavh_4JdjcatwXH-DD3hPwljAG4OfeAaaLrOJEXw Aug 09 11:19:06.454344 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Id: None Aug 09 11:19:06.454344 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Name: None Aug 09 11:19:06.454344 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Identity-Status: Confirmed Aug 09 11:19:06.454344 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Is-Admin-Project: True Aug 09 11:19:06.454344 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Id: default Aug 09 11:19:06.454344 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Name: Default Aug 09 11:19:06.454344 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Id: 8459b14a54824536b415b2b7336389df Aug 09 11:19:06.454344 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Name: tempest-DeleteServersTestJSON-745875447 Aug 09 11:19:06.454344 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Role: member,reader Aug 09 11:19:06.454344 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Roles: member,reader Aug 09 11:19:06.455543 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8459b14a54824536b415b2b7336389df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8459b14a54824536b415b2b7336389df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8459b14a54824536b415b2b7336389df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8459b14a54824536b415b2b7336389df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:19:06.455543 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant: tempest-DeleteServersTestJSON-745875447 Aug 09 11:19:06.455543 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Id: 8459b14a54824536b415b2b7336389df Aug 09 11:19:06.455543 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Name: tempest-DeleteServersTestJSON-745875447 Aug 09 11:19:06.455543 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User: tempest-DeleteServersTestJSON-745875447-project Aug 09 11:19:06.455543 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Id: default Aug 09 11:19:06.455543 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Name: Default Aug 09 11:19:06.455543 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Id: 69c8a0130c8e42c5b4a6ffe43d15865e Aug 09 11:19:06.455543 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Name: tempest-DeleteServersTestJSON-745875447-project Aug 09 11:19:06.455543 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: method: > Aug 09 11:19:06.455543 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: exception: Instance 629b5a40-87b1-42c3-91c7-5731966c0654 could not be found. Aug 09 11:19:06.455543 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: action_args: {'server_id': '629b5a40-87b1-42c3-91c7-5731966c0654'} Aug 09 11:19:06.456349 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:19:06.456349 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:19:06.456349 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:19:06.456349 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:19:06.456349 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:19:06.456349 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:19:06.456349 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:19:06.456349 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:19:06.456349 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:19:06.456349 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:19:06.456349 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 629b5a40-87b1-42c3-91c7-5731966c0654 could not be found. Aug 09 11:19:06.456349 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:19:06.456349 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:19:06.456349 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:19:06.456349 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:19:06.456349 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:19:06.456349 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:19:06.456349 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:19:06.456349 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:19:06.456349 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:19:06.457719 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:19:06.457719 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 11:19:06.457719 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 11:19:06.457719 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 11:19:06.457719 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 11:19:06.457719 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 09 11:19:06.457719 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 09 11:19:06.457719 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:19:06.457719 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:19:06.457719 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 629b5a40-87b1-42c3-91c7-5731966c0654 could not be found. Aug 09 11:19:06.457719 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:19:06.457719 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:19:06.457719 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:19:06.457719 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:19:06.457719 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:19:06.457719 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:19:06.457719 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:19:06.457719 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:19:06.457719 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 629b5a40-87b1-42c3-91c7-5731966c0654 could not be found. Aug 09 11:19:06.457719 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:19:06.458765 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-f107bac5-7fab-4363-9ec9-8a366b603814 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Returning 404 to user: Instance 629b5a40-87b1-42c3-91c7-5731966c0654 could not be found. {{(pid=117684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:19:06.458765 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-f107bac5-7fab-4363-9ec9-8a366b603814 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] 10.222.0.27 "GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.056847 Aug 09 11:19:06.458765 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 85/165] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 9 11:19:06 2022] GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654/os-volume_attachments => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:19:06.458954 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-d9484d5a-fb15-4875-82f8-53e85bd33460 req-f7ae996e-223c-43d1-8dae-27453147d682 service nova] Creating event network-changed:a0e1df8f-6c5d-403e-b534-35078a35e14f for instance b52e58fe-0ca0-47f5-9824-8edd6509d2ee on hv-cinder-85251 Aug 09 11:19:06.462975 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-d9484d5a-fb15-4875-82f8-53e85bd33460 req-f7ae996e-223c-43d1-8dae-27453147d682 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045298 Aug 09 11:19:06.463738 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 81/166] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:19:07.423202 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-8d08bce9-8856-487d-948b-f863e73df5cc tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:07.423698 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-8d08bce9-8856-487d-948b-f863e73df5cc tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] [instance: 5649e5ff-fbc3-41b1-be08-7546eea1115f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:07.431269 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8d08bce9-8856-487d-948b-f863e73df5cc tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:07.431756 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8d08bce9-8856-487d-948b-f863e73df5cc tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:07.432190 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8d08bce9-8856-487d-948b-f863e73df5cc tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:07.432898 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8d08bce9-8856-487d-948b-f863e73df5cc tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:07.433362 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8d08bce9-8856-487d-948b-f863e73df5cc tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:07.433784 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8d08bce9-8856-487d-948b-f863e73df5cc tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:07.435393 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-32023706-654c-4d5b-ac4f-a950b4b9b870 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:07.436086 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-32023706-654c-4d5b-ac4f-a950b4b9b870 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] [instance: b52e58fe-0ca0-47f5-9824-8edd6509d2ee] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:07.442639 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-32023706-654c-4d5b-ac4f-a950b4b9b870 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:07.443375 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-32023706-654c-4d5b-ac4f-a950b4b9b870 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:07.443809 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-32023706-654c-4d5b-ac4f-a950b4b9b870 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:07.444542 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-32023706-654c-4d5b-ac4f-a950b4b9b870 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:07.444994 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-32023706-654c-4d5b-ac4f-a950b4b9b870 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:07.445428 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-32023706-654c-4d5b-ac4f-a950b4b9b870 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:07.642930 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-8d08bce9-8856-487d-948b-f863e73df5cc tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c011df2b144f758dd286e77875bcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37fc7dacc11483ca9c6f047d3bd2553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:07.653476 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-32023706-654c-4d5b-ac4f-a950b4b9b870 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87689334264c4a939367f091ccfbd642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8bd6fe9ca418d9e295aa3f419f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:07.665645 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-8d08bce9-8856-487d-948b-f863e73df5cc tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] 10.222.0.27 "GET /compute/v2.1/servers/5649e5ff-fbc3-41b1-be08-7546eea1115f" status: 200 len: 1504 microversion: 2.1 time: 0.246393 Aug 09 11:19:07.666163 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-32023706-654c-4d5b-ac4f-a950b4b9b870 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] 10.222.0.27 "GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee" status: 200 len: 1314 microversion: 2.1 time: 0.235424 Aug 09 11:19:07.666273 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 86/167] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:07 2022] GET /compute/v2.1/servers/5649e5ff-fbc3-41b1-be08-7546eea1115f => generated 1504 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:07.679987 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 82/168] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:07 2022] GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:07.698199 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-618431de-a90d-4214-a8c1-086c95c52131 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:07.698699 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-618431de-a90d-4214-a8c1-086c95c52131 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] [instance: 629b5a40-87b1-42c3-91c7-5731966c0654] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:07.705060 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-618431de-a90d-4214-a8c1-086c95c52131 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:07.705643 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-618431de-a90d-4214-a8c1-086c95c52131 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:07.706074 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-618431de-a90d-4214-a8c1-086c95c52131 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:07.706773 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-618431de-a90d-4214-a8c1-086c95c52131 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:07.707564 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-618431de-a90d-4214-a8c1-086c95c52131 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:07.707985 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-618431de-a90d-4214-a8c1-086c95c52131 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:07.722520 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.wsgi [None req-618431de-a90d-4214-a8c1-086c95c52131 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] HTTP exception thrown: Instance 629b5a40-87b1-42c3-91c7-5731966c0654 could not be found. Aug 09 11:19:07.724902 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-618431de-a90d-4214-a8c1-086c95c52131 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Request method failure captured: Aug 09 11:19:07.724902 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: request: DELETE /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654 HTTP/1.1 Aug 09 11:19:07.724902 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept: application/json Aug 09 11:19:07.724902 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept-Encoding: identity Aug 09 11:19:07.724902 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Connection: close Aug 09 11:19:07.724902 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Length: 0 Aug 09 11:19:07.724902 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Type: application/json Aug 09 11:19:07.724902 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Host: 10.222.0.27 Aug 09 11:19:07.724902 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Openstack-System-Scope: None Aug 09 11:19:07.724902 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: User-Agent: python-urllib3/1.26.11 Aug 09 11:19:07.724902 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Auth-Token: gAAAAABi8kJpRrt7HOih2AefZ54OLsTXZPEX0zaLTC8d2ShyfVCdvjU8ptQfB0EOf3dAGS5b8vxoPyVvcqLLSnkFilZAJNerJq2ZJzaDpEB6a0tdP9wvYYYfwZMu4KVEFPOxt4ZxchsH30IVavh_4JdjcatwXH-DD3hPwljAG4OfeAaaLrOJEXw Aug 09 11:19:07.724902 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Id: None Aug 09 11:19:07.724902 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Name: None Aug 09 11:19:07.724902 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Identity-Status: Confirmed Aug 09 11:19:07.724902 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Is-Admin-Project: True Aug 09 11:19:07.724902 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Id: default Aug 09 11:19:07.724902 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Name: Default Aug 09 11:19:07.724902 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Id: 8459b14a54824536b415b2b7336389df Aug 09 11:19:07.724902 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Name: tempest-DeleteServersTestJSON-745875447 Aug 09 11:19:07.724902 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Role: member,reader Aug 09 11:19:07.724902 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Roles: member,reader Aug 09 11:19:07.726229 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8459b14a54824536b415b2b7336389df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8459b14a54824536b415b2b7336389df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8459b14a54824536b415b2b7336389df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8459b14a54824536b415b2b7336389df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:19:07.726229 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant: tempest-DeleteServersTestJSON-745875447 Aug 09 11:19:07.726229 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Id: 8459b14a54824536b415b2b7336389df Aug 09 11:19:07.726229 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Name: tempest-DeleteServersTestJSON-745875447 Aug 09 11:19:07.726229 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User: tempest-DeleteServersTestJSON-745875447-project Aug 09 11:19:07.726229 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Id: default Aug 09 11:19:07.726229 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Name: Default Aug 09 11:19:07.726229 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Id: 69c8a0130c8e42c5b4a6ffe43d15865e Aug 09 11:19:07.726229 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Name: tempest-DeleteServersTestJSON-745875447-project Aug 09 11:19:07.726229 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: method: > Aug 09 11:19:07.726229 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: exception: Instance 629b5a40-87b1-42c3-91c7-5731966c0654 could not be found. Aug 09 11:19:07.726229 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: action_args: {'id': '629b5a40-87b1-42c3-91c7-5731966c0654'} Aug 09 11:19:07.726979 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:19:07.726979 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:19:07.726979 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:19:07.726979 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:19:07.726979 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:19:07.726979 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:19:07.726979 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:19:07.726979 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:19:07.726979 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:19:07.726979 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:19:07.726979 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 629b5a40-87b1-42c3-91c7-5731966c0654 could not be found. Aug 09 11:19:07.726979 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:19:07.726979 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:19:07.726979 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:19:07.726979 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:19:07.726979 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:19:07.726979 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:19:07.726979 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:19:07.726979 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:19:07.726979 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:19:07.728023 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:19:07.728023 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 11:19:07.728023 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 11:19:07.728023 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 11:19:07.728023 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 11:19:07.728023 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:19:07.728023 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:19:07.728023 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:19:07.728023 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:19:07.728023 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 629b5a40-87b1-42c3-91c7-5731966c0654 could not be found. Aug 09 11:19:07.728023 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:19:07.728023 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:19:07.728023 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:19:07.728023 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:19:07.728023 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:19:07.728023 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:19:07.728023 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:19:07.728023 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:19:07.728023 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 629b5a40-87b1-42c3-91c7-5731966c0654 could not be found. Aug 09 11:19:07.728023 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:19:07.729096 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-618431de-a90d-4214-a8c1-086c95c52131 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Returning 404 to user: Instance 629b5a40-87b1-42c3-91c7-5731966c0654 could not be found. {{(pid=117684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:19:07.729096 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-618431de-a90d-4214-a8c1-086c95c52131 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] 10.222.0.27 "DELETE /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654" status: 404 len: 111 microversion: 2.1 time: 0.032192 Aug 09 11:19:07.729096 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 87/169] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 9 11:19:07 2022] DELETE /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:19:07.735364 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-745ee09e-b2ce-4264-aa63-0e50cb1652b6 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:07.735971 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-745ee09e-b2ce-4264-aa63-0e50cb1652b6 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] [instance: 629b5a40-87b1-42c3-91c7-5731966c0654] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:07.742646 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-745ee09e-b2ce-4264-aa63-0e50cb1652b6 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:07.743167 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-745ee09e-b2ce-4264-aa63-0e50cb1652b6 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:07.743603 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-745ee09e-b2ce-4264-aa63-0e50cb1652b6 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:07.744321 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-745ee09e-b2ce-4264-aa63-0e50cb1652b6 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:07.744765 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-745ee09e-b2ce-4264-aa63-0e50cb1652b6 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:07.745359 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-745ee09e-b2ce-4264-aa63-0e50cb1652b6 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:07.761622 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.wsgi [None req-745ee09e-b2ce-4264-aa63-0e50cb1652b6 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] HTTP exception thrown: Instance 629b5a40-87b1-42c3-91c7-5731966c0654 could not be found. Aug 09 11:19:07.763489 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-745ee09e-b2ce-4264-aa63-0e50cb1652b6 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Request method failure captured: Aug 09 11:19:07.763489 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: request: GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654 HTTP/1.1 Aug 09 11:19:07.763489 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Accept: application/json Aug 09 11:19:07.763489 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Accept-Encoding: identity Aug 09 11:19:07.763489 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Connection: close Aug 09 11:19:07.763489 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Content-Length: 0 Aug 09 11:19:07.763489 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Content-Type: application/json Aug 09 11:19:07.763489 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Host: 10.222.0.27 Aug 09 11:19:07.763489 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Openstack-System-Scope: None Aug 09 11:19:07.763489 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: User-Agent: python-urllib3/1.26.11 Aug 09 11:19:07.763489 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Auth-Token: gAAAAABi8kJpRrt7HOih2AefZ54OLsTXZPEX0zaLTC8d2ShyfVCdvjU8ptQfB0EOf3dAGS5b8vxoPyVvcqLLSnkFilZAJNerJq2ZJzaDpEB6a0tdP9wvYYYfwZMu4KVEFPOxt4ZxchsH30IVavh_4JdjcatwXH-DD3hPwljAG4OfeAaaLrOJEXw Aug 09 11:19:07.763489 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Domain-Id: None Aug 09 11:19:07.763489 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Domain-Name: None Aug 09 11:19:07.763489 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Identity-Status: Confirmed Aug 09 11:19:07.763489 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Is-Admin-Project: True Aug 09 11:19:07.763489 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Domain-Id: default Aug 09 11:19:07.763489 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Domain-Name: Default Aug 09 11:19:07.763489 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Id: 8459b14a54824536b415b2b7336389df Aug 09 11:19:07.763489 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Name: tempest-DeleteServersTestJSON-745875447 Aug 09 11:19:07.763489 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Role: member,reader Aug 09 11:19:07.763489 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Roles: member,reader Aug 09 11:19:07.764705 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8459b14a54824536b415b2b7336389df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8459b14a54824536b415b2b7336389df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8459b14a54824536b415b2b7336389df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8459b14a54824536b415b2b7336389df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:19:07.764705 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant: tempest-DeleteServersTestJSON-745875447 Aug 09 11:19:07.764705 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant-Id: 8459b14a54824536b415b2b7336389df Aug 09 11:19:07.764705 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant-Name: tempest-DeleteServersTestJSON-745875447 Aug 09 11:19:07.764705 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User: tempest-DeleteServersTestJSON-745875447-project Aug 09 11:19:07.764705 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Domain-Id: default Aug 09 11:19:07.764705 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Domain-Name: Default Aug 09 11:19:07.764705 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Id: 69c8a0130c8e42c5b4a6ffe43d15865e Aug 09 11:19:07.764705 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Name: tempest-DeleteServersTestJSON-745875447-project Aug 09 11:19:07.764705 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: method: > Aug 09 11:19:07.764705 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: exception: Instance 629b5a40-87b1-42c3-91c7-5731966c0654 could not be found. Aug 09 11:19:07.764705 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: action_args: {'id': '629b5a40-87b1-42c3-91c7-5731966c0654'} Aug 09 11:19:07.765356 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:19:07.765356 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:19:07.765356 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:19:07.765356 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:19:07.765356 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:19:07.765356 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:19:07.765356 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:19:07.765356 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:19:07.765356 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:19:07.765356 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:19:07.765356 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 629b5a40-87b1-42c3-91c7-5731966c0654 could not be found. Aug 09 11:19:07.765356 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:19:07.765356 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:19:07.765356 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:19:07.765356 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:19:07.765356 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:19:07.765356 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:19:07.765356 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:19:07.765356 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:19:07.765356 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:19:07.766377 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:19:07.766377 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:19:07.766377 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:19:07.766377 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:19:07.766377 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:19:07.766377 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:19:07.766377 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:19:07.766377 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 629b5a40-87b1-42c3-91c7-5731966c0654 could not be found. Aug 09 11:19:07.766377 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:19:07.766377 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:19:07.766377 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:19:07.766377 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:19:07.766377 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:19:07.766377 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:19:07.766377 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:19:07.766377 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:19:07.766377 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 629b5a40-87b1-42c3-91c7-5731966c0654 could not be found. Aug 09 11:19:07.766377 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:19:07.767294 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-745ee09e-b2ce-4264-aa63-0e50cb1652b6 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] Returning 404 to user: Instance 629b5a40-87b1-42c3-91c7-5731966c0654 could not be found. {{(pid=117685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:19:07.767294 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-745ee09e-b2ce-4264-aa63-0e50cb1652b6 tempest-DeleteServersTestJSON-745875447 tempest-DeleteServersTestJSON-745875447-project] 10.222.0.27 "GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654" status: 404 len: 111 microversion: 2.1 time: 0.033526 Aug 09 11:19:07.769359 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 83/170] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:07 2022] GET /compute/v2.1/servers/629b5a40-87b1-42c3-91c7-5731966c0654 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 11:19:08.686772 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-58c10387-e388-4050-8a2f-4be71ce992a2 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:08.688034 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-58c10387-e388-4050-8a2f-4be71ce992a2 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] [instance: 5649e5ff-fbc3-41b1-be08-7546eea1115f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:08.689257 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-aef812ba-559d-4fa2-92c8-dc1ced049326 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:08.690938 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-aef812ba-559d-4fa2-92c8-dc1ced049326 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] [instance: b52e58fe-0ca0-47f5-9824-8edd6509d2ee] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:08.695524 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-58c10387-e388-4050-8a2f-4be71ce992a2 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:08.696002 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-58c10387-e388-4050-8a2f-4be71ce992a2 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:08.696459 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-58c10387-e388-4050-8a2f-4be71ce992a2 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:08.697187 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-58c10387-e388-4050-8a2f-4be71ce992a2 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:08.697604 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-58c10387-e388-4050-8a2f-4be71ce992a2 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:08.698018 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-58c10387-e388-4050-8a2f-4be71ce992a2 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:08.702052 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-aef812ba-559d-4fa2-92c8-dc1ced049326 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:08.703537 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-aef812ba-559d-4fa2-92c8-dc1ced049326 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:08.704721 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-aef812ba-559d-4fa2-92c8-dc1ced049326 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:08.705687 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-aef812ba-559d-4fa2-92c8-dc1ced049326 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:08.707616 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-aef812ba-559d-4fa2-92c8-dc1ced049326 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:08.709111 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-aef812ba-559d-4fa2-92c8-dc1ced049326 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:08.900629 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-58c10387-e388-4050-8a2f-4be71ce992a2 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c011df2b144f758dd286e77875bcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37fc7dacc11483ca9c6f047d3bd2553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:08.917843 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-58c10387-e388-4050-8a2f-4be71ce992a2 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] 10.222.0.27 "GET /compute/v2.1/servers/5649e5ff-fbc3-41b1-be08-7546eea1115f" status: 200 len: 1504 microversion: 2.1 time: 0.234882 Aug 09 11:19:08.924172 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 88/171] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:08 2022] GET /compute/v2.1/servers/5649e5ff-fbc3-41b1-be08-7546eea1115f => generated 1504 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:08.933909 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-aef812ba-559d-4fa2-92c8-dc1ced049326 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87689334264c4a939367f091ccfbd642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8bd6fe9ca418d9e295aa3f419f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:08.942534 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-aef812ba-559d-4fa2-92c8-dc1ced049326 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] 10.222.0.27 "GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee" status: 200 len: 1314 microversion: 2.1 time: 0.258986 Aug 09 11:19:08.943051 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 84/172] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:08 2022] GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:09.945992 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-5944ccb8-6dd9-4ca5-9b86-abe819a8afff tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:09.946795 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-5944ccb8-6dd9-4ca5-9b86-abe819a8afff tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] [instance: 5649e5ff-fbc3-41b1-be08-7546eea1115f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:09.954950 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5944ccb8-6dd9-4ca5-9b86-abe819a8afff tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:09.955546 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5944ccb8-6dd9-4ca5-9b86-abe819a8afff tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:09.956052 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5944ccb8-6dd9-4ca5-9b86-abe819a8afff tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:09.956904 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5944ccb8-6dd9-4ca5-9b86-abe819a8afff tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:09.957337 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5944ccb8-6dd9-4ca5-9b86-abe819a8afff tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:09.958137 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5944ccb8-6dd9-4ca5-9b86-abe819a8afff tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:09.965030 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-fdfd9717-a745-469e-8453-3f5f067d5cf6 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:09.965768 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-fdfd9717-a745-469e-8453-3f5f067d5cf6 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] [instance: b52e58fe-0ca0-47f5-9824-8edd6509d2ee] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:09.972773 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fdfd9717-a745-469e-8453-3f5f067d5cf6 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:09.973343 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fdfd9717-a745-469e-8453-3f5f067d5cf6 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:09.973830 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fdfd9717-a745-469e-8453-3f5f067d5cf6 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:09.974572 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fdfd9717-a745-469e-8453-3f5f067d5cf6 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:09.975087 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fdfd9717-a745-469e-8453-3f5f067d5cf6 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:09.976041 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fdfd9717-a745-469e-8453-3f5f067d5cf6 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:10.179225 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-5944ccb8-6dd9-4ca5-9b86-abe819a8afff tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c011df2b144f758dd286e77875bcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37fc7dacc11483ca9c6f047d3bd2553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:10.186967 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-fdfd9717-a745-469e-8453-3f5f067d5cf6 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87689334264c4a939367f091ccfbd642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8bd6fe9ca418d9e295aa3f419f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:10.194412 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-5944ccb8-6dd9-4ca5-9b86-abe819a8afff tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] 10.222.0.27 "GET /compute/v2.1/servers/5649e5ff-fbc3-41b1-be08-7546eea1115f" status: 200 len: 1504 microversion: 2.1 time: 0.252413 Aug 09 11:19:10.194679 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-fdfd9717-a745-469e-8453-3f5f067d5cf6 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] 10.222.0.27 "GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee" status: 200 len: 1314 microversion: 2.1 time: 0.235330 Aug 09 11:19:10.195001 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 89/173] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:09 2022] GET /compute/v2.1/servers/5649e5ff-fbc3-41b1-be08-7546eea1115f => generated 1504 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:19:10.204821 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 85/174] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:09 2022] GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:19:10.373354 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [req-eb1eeab7-154a-418a-a887-f90e6a95db4d req-d8b53f0a-c4b9-4889-9e8c-c5c161bdc5ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5649e5ff-fbc3-41b1-be08-7546eea1115f", "name": "network-vif-deleted", "tag": "ab6cf532-9f0c-4206-b8be-c5aaec8ea5e5"}]} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:19:10.386172 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-eb1eeab7-154a-418a-a887-f90e6a95db4d req-d8b53f0a-c4b9-4889-9e8c-c5c161bdc5ef service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:10.386713 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-eb1eeab7-154a-418a-a887-f90e6a95db4d req-d8b53f0a-c4b9-4889-9e8c-c5c161bdc5ef service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:10.387188 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-eb1eeab7-154a-418a-a887-f90e6a95db4d req-d8b53f0a-c4b9-4889-9e8c-c5c161bdc5ef service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:10.401759 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.compute.server_external_events [req-eb1eeab7-154a-418a-a887-f90e6a95db4d req-d8b53f0a-c4b9-4889-9e8c-c5c161bdc5ef service nova] Creating event network-vif-deleted:ab6cf532-9f0c-4206-b8be-c5aaec8ea5e5 for instance 5649e5ff-fbc3-41b1-be08-7546eea1115f on hv-cinder-85251 Aug 09 11:19:10.406947 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [req-eb1eeab7-154a-418a-a887-f90e6a95db4d req-d8b53f0a-c4b9-4889-9e8c-c5c161bdc5ef service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037624 Aug 09 11:19:10.407545 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 90/175] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:19:11.215523 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-12a244ce-2200-40a6-8c11-f2b6ead7ae58 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:11.216967 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-12a244ce-2200-40a6-8c11-f2b6ead7ae58 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] [instance: 5649e5ff-fbc3-41b1-be08-7546eea1115f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:11.223651 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-12a244ce-2200-40a6-8c11-f2b6ead7ae58 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:11.224430 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-12a244ce-2200-40a6-8c11-f2b6ead7ae58 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:11.224804 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-12a244ce-2200-40a6-8c11-f2b6ead7ae58 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:11.225716 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-12a244ce-2200-40a6-8c11-f2b6ead7ae58 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:11.226160 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-12a244ce-2200-40a6-8c11-f2b6ead7ae58 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:11.226575 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-12a244ce-2200-40a6-8c11-f2b6ead7ae58 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:11.229176 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-c9009f6f-e513-4a31-9c57-65b17bf0e33c tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:11.230211 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-c9009f6f-e513-4a31-9c57-65b17bf0e33c tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] [instance: b52e58fe-0ca0-47f5-9824-8edd6509d2ee] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:11.237726 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c9009f6f-e513-4a31-9c57-65b17bf0e33c tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:11.238212 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c9009f6f-e513-4a31-9c57-65b17bf0e33c tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:11.238638 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c9009f6f-e513-4a31-9c57-65b17bf0e33c tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:11.239403 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c9009f6f-e513-4a31-9c57-65b17bf0e33c tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:11.239878 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c9009f6f-e513-4a31-9c57-65b17bf0e33c tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:11.240768 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c9009f6f-e513-4a31-9c57-65b17bf0e33c tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:11.241313 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.wsgi [None req-12a244ce-2200-40a6-8c11-f2b6ead7ae58 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] HTTP exception thrown: Instance 5649e5ff-fbc3-41b1-be08-7546eea1115f could not be found. Aug 09 11:19:11.242855 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-12a244ce-2200-40a6-8c11-f2b6ead7ae58 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Request method failure captured: Aug 09 11:19:11.242855 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: request: GET /compute/v2.1/servers/5649e5ff-fbc3-41b1-be08-7546eea1115f HTTP/1.1 Aug 09 11:19:11.242855 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Accept: application/json Aug 09 11:19:11.242855 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Accept-Encoding: identity Aug 09 11:19:11.242855 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Connection: close Aug 09 11:19:11.242855 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Content-Length: 0 Aug 09 11:19:11.242855 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Content-Type: application/json Aug 09 11:19:11.242855 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Host: 10.222.0.27 Aug 09 11:19:11.242855 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Openstack-System-Scope: None Aug 09 11:19:11.242855 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: User-Agent: python-urllib3/1.26.11 Aug 09 11:19:11.242855 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Auth-Token: gAAAAABi8kKPXT5Az0fyiHWu7Crf9-MUHsm0CEjd_NdpmmGr3EZTy56KmGHAc4XLGezMg-xmO6oR4Pj_49j1sFYKcfyabe9M47VDph9P2SSSU6Cz1L9QTLPg2AsySkBlHb_CO4Mi443Hq3RWwBJHmpTNRixHbzp8sjtvf09tgrNjwCWSlBgQjq0 Aug 09 11:19:11.242855 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Domain-Id: None Aug 09 11:19:11.242855 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Domain-Name: None Aug 09 11:19:11.242855 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Identity-Status: Confirmed Aug 09 11:19:11.242855 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Is-Admin-Project: True Aug 09 11:19:11.242855 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Domain-Id: default Aug 09 11:19:11.242855 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Domain-Name: Default Aug 09 11:19:11.242855 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Id: b37fc7dacc11483ca9c6f047d3bd2553 Aug 09 11:19:11.242855 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Name: tempest-VolumesActionsTest-475547032 Aug 09 11:19:11.242855 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Role: member,reader Aug 09 11:19:11.242855 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Roles: member,reader Aug 09 11:19:11.244038 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b37fc7dacc11483ca9c6f047d3bd2553"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b37fc7dacc11483ca9c6f047d3bd2553"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b37fc7dacc11483ca9c6f047d3bd2553"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b37fc7dacc11483ca9c6f047d3bd2553"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:19:11.244038 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant: tempest-VolumesActionsTest-475547032 Aug 09 11:19:11.244038 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant-Id: b37fc7dacc11483ca9c6f047d3bd2553 Aug 09 11:19:11.244038 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant-Name: tempest-VolumesActionsTest-475547032 Aug 09 11:19:11.244038 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User: tempest-VolumesActionsTest-475547032-project Aug 09 11:19:11.244038 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Domain-Id: default Aug 09 11:19:11.244038 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Domain-Name: Default Aug 09 11:19:11.244038 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Id: b3c011df2b144f758dd286e77875bcc8 Aug 09 11:19:11.244038 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Name: tempest-VolumesActionsTest-475547032-project Aug 09 11:19:11.244038 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: method: > Aug 09 11:19:11.244038 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: exception: Instance 5649e5ff-fbc3-41b1-be08-7546eea1115f could not be found. Aug 09 11:19:11.244038 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: action_args: {'id': '5649e5ff-fbc3-41b1-be08-7546eea1115f'} Aug 09 11:19:11.244808 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:19:11.244808 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:19:11.244808 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:19:11.244808 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:19:11.244808 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:19:11.244808 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:19:11.244808 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:19:11.244808 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:19:11.244808 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:19:11.244808 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:19:11.244808 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5649e5ff-fbc3-41b1-be08-7546eea1115f could not be found. Aug 09 11:19:11.244808 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:19:11.244808 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:19:11.244808 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:19:11.244808 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:19:11.244808 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:19:11.244808 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:19:11.244808 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:19:11.244808 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:19:11.244808 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:19:11.246184 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:19:11.246184 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:19:11.246184 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:19:11.246184 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:19:11.246184 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:19:11.246184 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:19:11.246184 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:19:11.246184 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5649e5ff-fbc3-41b1-be08-7546eea1115f could not be found. Aug 09 11:19:11.246184 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:19:11.246184 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:19:11.246184 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:19:11.246184 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:19:11.246184 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:19:11.246184 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:19:11.246184 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:19:11.246184 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:19:11.246184 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5649e5ff-fbc3-41b1-be08-7546eea1115f could not be found. Aug 09 11:19:11.246184 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:19:11.247136 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-12a244ce-2200-40a6-8c11-f2b6ead7ae58 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Returning 404 to user: Instance 5649e5ff-fbc3-41b1-be08-7546eea1115f could not be found. {{(pid=117685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:19:11.247136 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-12a244ce-2200-40a6-8c11-f2b6ead7ae58 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] 10.222.0.27 "GET /compute/v2.1/servers/5649e5ff-fbc3-41b1-be08-7546eea1115f" status: 404 len: 111 microversion: 2.1 time: 0.033025 Aug 09 11:19:11.247136 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 86/176] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:11 2022] GET /compute/v2.1/servers/5649e5ff-fbc3-41b1-be08-7546eea1115f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:19:11.379023 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-c6bb047e-e958-4b72-adbd-c21735193e92 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-15758447", "imageRef": "2321e9a0-fe0f-47fd-9c4b-8868eb5a00af", "flavorRef": "452", "networks": [{"uuid": "b186ad16-42dd-42cc-9160-e6aad8baa604"}]}} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:19:11.391070 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-c9009f6f-e513-4a31-9c57-65b17bf0e33c tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87689334264c4a939367f091ccfbd642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8bd6fe9ca418d9e295aa3f419f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:11.399923 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-c9009f6f-e513-4a31-9c57-65b17bf0e33c tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] 10.222.0.27 "GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee" status: 200 len: 1314 microversion: 2.1 time: 0.176529 Aug 09 11:19:11.421746 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 91/177] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:11 2022] GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:19:11.450030 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.network.neutron [None req-c6bb047e-e958-4b72-adbd-c21735193e92 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] validate_networks() for [('b186ad16-42dd-42cc-9160-e6aad8baa604', None, None, None, None, None)] {{(pid=117685) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 11:19:12.161657 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-c6bb047e-e958-4b72-adbd-c21735193e92 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Flavor limits 0:0:0 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 11:19:12.162072 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-c6bb047e-e958-4b72-adbd-c21735193e92 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Image limits 0:0:0 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 11:19:12.162532 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-c6bb047e-e958-4b72-adbd-c21735193e92 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Flavor pref 0:0:0 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 11:19:12.163112 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-c6bb047e-e958-4b72-adbd-c21735193e92 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Image pref 0:0:0 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 11:19:12.163672 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-c6bb047e-e958-4b72-adbd-c21735193e92 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 11:19:12.185383 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c6bb047e-e958-4b72-adbd-c21735193e92 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:12.186122 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c6bb047e-e958-4b72-adbd-c21735193e92 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:12.188597 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c6bb047e-e958-4b72-adbd-c21735193e92 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:12.189448 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c6bb047e-e958-4b72-adbd-c21735193e92 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:12.190064 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c6bb047e-e958-4b72-adbd-c21735193e92 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:12.190623 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c6bb047e-e958-4b72-adbd-c21735193e92 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:12.228699 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.quota [None req-c6bb047e-e958-4b72-adbd-c21735193e92 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Getting quotas for project b37fc7dacc11483ca9c6f047d3bd2553. Resources: {'cores', 'instances', 'ram'} {{(pid=117685) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:19:12.239151 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.quota [None req-c6bb047e-e958-4b72-adbd-c21735193e92 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Getting quotas for user b3c011df2b144f758dd286e77875bcc8 and project b37fc7dacc11483ca9c6f047d3bd2553. Resources: {'cores', 'instances', 'ram'} {{(pid=117685) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:19:12.265415 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-c6bb047e-e958-4b72-adbd-c21735193e92 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Going to run 1 instances... {{(pid=117685) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 11:19:12.267765 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-c6bb047e-e958-4b72-adbd-c21735193e92 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] [instance: e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2321e9a0-fe0f-47fd-9c4b-8868eb5a00af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117685) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 11:19:12.363621 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-c6bb047e-e958-4b72-adbd-c21735193e92 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.989963 Aug 09 11:19:12.365065 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 87/178] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 9 11:19:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 993 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 11:19:12.379769 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-fd3fbb06-07c9-4a31-a5e0-14cd4c1e0191 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:12.381100 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-fd3fbb06-07c9-4a31-a5e0-14cd4c1e0191 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] [instance: e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:12.432337 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-b023cb70-598a-4ea4-9bbb-29cfd307aad0 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:12.434578 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-b023cb70-598a-4ea4-9bbb-29cfd307aad0 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] [instance: b52e58fe-0ca0-47f5-9824-8edd6509d2ee] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:12.453190 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_api:INSERT=9,nova_api:SELECT=90,nova_api:UPDATE=1 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:12.461420 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b023cb70-598a-4ea4-9bbb-29cfd307aad0 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:12.463533 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b023cb70-598a-4ea4-9bbb-29cfd307aad0 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:12.468830 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b023cb70-598a-4ea4-9bbb-29cfd307aad0 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:12.469678 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b023cb70-598a-4ea4-9bbb-29cfd307aad0 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:12.470223 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b023cb70-598a-4ea4-9bbb-29cfd307aad0 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:12.471458 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b023cb70-598a-4ea4-9bbb-29cfd307aad0 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:12.490180 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-fd3fbb06-07c9-4a31-a5e0-14cd4c1e0191 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c011df2b144f758dd286e77875bcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37fc7dacc11483ca9c6f047d3bd2553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:12.500839 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-fd3fbb06-07c9-4a31-a5e0-14cd4c1e0191 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] 10.222.0.27 "GET /compute/v2.1/servers/e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6" status: 200 len: 1212 microversion: 2.1 time: 0.128872 Aug 09 11:19:12.502042 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 92/179] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:12 2022] GET /compute/v2.1/servers/e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6 => generated 1212 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:12.542838 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:12.756201 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-b023cb70-598a-4ea4-9bbb-29cfd307aad0 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87689334264c4a939367f091ccfbd642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8bd6fe9ca418d9e295aa3f419f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:12.766203 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-b023cb70-598a-4ea4-9bbb-29cfd307aad0 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] 10.222.0.27 "GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee" status: 200 len: 1314 microversion: 2.1 time: 0.345585 Aug 09 11:19:12.767084 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 88/180] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:12 2022] GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:13.522547 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-d02cef44-e15e-4c21-a7bf-f9cc68a5e954 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:13.523153 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-d02cef44-e15e-4c21-a7bf-f9cc68a5e954 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] [instance: e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:13.532006 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d02cef44-e15e-4c21-a7bf-f9cc68a5e954 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:13.535506 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d02cef44-e15e-4c21-a7bf-f9cc68a5e954 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:13.538532 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d02cef44-e15e-4c21-a7bf-f9cc68a5e954 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:13.539302 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d02cef44-e15e-4c21-a7bf-f9cc68a5e954 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:13.540159 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d02cef44-e15e-4c21-a7bf-f9cc68a5e954 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:13.541359 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d02cef44-e15e-4c21-a7bf-f9cc68a5e954 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:13.614472 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-d02cef44-e15e-4c21-a7bf-f9cc68a5e954 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c011df2b144f758dd286e77875bcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37fc7dacc11483ca9c6f047d3bd2553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:13.615127 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-5b4d9943-3f7f-4a75-b7d3-1074707acff7 req-07ab0e40-0e27-46df-a06b-e8d646cfa770 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b52e58fe-0ca0-47f5-9824-8edd6509d2ee", "name": "network-vif-plugged", "status": "completed", "tag": "a0e1df8f-6c5d-403e-b534-35078a35e14f"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:19:13.622235 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-d02cef44-e15e-4c21-a7bf-f9cc68a5e954 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] 10.222.0.27 "GET /compute/v2.1/servers/e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6" status: 200 len: 1264 microversion: 2.1 time: 0.103841 Aug 09 11:19:13.624765 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 93/181] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:13 2022] GET /compute/v2.1/servers/e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6 => generated 1264 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:13.633615 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-5b4d9943-3f7f-4a75-b7d3-1074707acff7 req-07ab0e40-0e27-46df-a06b-e8d646cfa770 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:13.634228 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-5b4d9943-3f7f-4a75-b7d3-1074707acff7 req-07ab0e40-0e27-46df-a06b-e8d646cfa770 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:13.635010 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-5b4d9943-3f7f-4a75-b7d3-1074707acff7 req-07ab0e40-0e27-46df-a06b-e8d646cfa770 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:13.661494 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-5b4d9943-3f7f-4a75-b7d3-1074707acff7 req-07ab0e40-0e27-46df-a06b-e8d646cfa770 service nova] Creating event network-vif-plugged:a0e1df8f-6c5d-403e-b534-35078a35e14f for instance b52e58fe-0ca0-47f5-9824-8edd6509d2ee on hv-cinder-85251 Aug 09 11:19:13.667214 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-5b4d9943-3f7f-4a75-b7d3-1074707acff7 req-07ab0e40-0e27-46df-a06b-e8d646cfa770 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055681 Aug 09 11:19:13.677340 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 89/182] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:19:13.790170 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-893ee614-3026-4ef5-90a4-ffe1629fc4a4 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:13.790792 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-893ee614-3026-4ef5-90a4-ffe1629fc4a4 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] [instance: b52e58fe-0ca0-47f5-9824-8edd6509d2ee] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:13.799231 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-893ee614-3026-4ef5-90a4-ffe1629fc4a4 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:13.799769 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-893ee614-3026-4ef5-90a4-ffe1629fc4a4 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:13.800213 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-893ee614-3026-4ef5-90a4-ffe1629fc4a4 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:13.800952 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-893ee614-3026-4ef5-90a4-ffe1629fc4a4 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:13.801399 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-893ee614-3026-4ef5-90a4-ffe1629fc4a4 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:13.803320 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-893ee614-3026-4ef5-90a4-ffe1629fc4a4 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:14.125769 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-893ee614-3026-4ef5-90a4-ffe1629fc4a4 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87689334264c4a939367f091ccfbd642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8bd6fe9ca418d9e295aa3f419f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:14.137642 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-893ee614-3026-4ef5-90a4-ffe1629fc4a4 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] 10.222.0.27 "GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee" status: 200 len: 1314 microversion: 2.1 time: 0.351355 Aug 09 11:19:14.149253 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 94/183] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:13 2022] GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:14.651941 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-21ad8593-84f1-4083-832c-c2c071ca4344 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:14.655495 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-21ad8593-84f1-4083-832c-c2c071ca4344 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] [instance: e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:14.665831 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-21ad8593-84f1-4083-832c-c2c071ca4344 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:14.666445 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-21ad8593-84f1-4083-832c-c2c071ca4344 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:14.666975 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-21ad8593-84f1-4083-832c-c2c071ca4344 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:14.667912 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-21ad8593-84f1-4083-832c-c2c071ca4344 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:14.668968 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-21ad8593-84f1-4083-832c-c2c071ca4344 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:14.669515 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-21ad8593-84f1-4083-832c-c2c071ca4344 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:14.761163 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-21ad8593-84f1-4083-832c-c2c071ca4344 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c011df2b144f758dd286e77875bcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37fc7dacc11483ca9c6f047d3bd2553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:14.780949 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-21ad8593-84f1-4083-832c-c2c071ca4344 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] 10.222.0.27 "GET /compute/v2.1/servers/e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6" status: 200 len: 1270 microversion: 2.1 time: 0.136233 Aug 09 11:19:14.782006 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 90/184] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:14 2022] GET /compute/v2.1/servers/e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6 => generated 1270 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:15.161912 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-3890d788-2b10-493e-8724-5671c7c9708a tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:15.161912 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-3890d788-2b10-493e-8724-5671c7c9708a tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] [instance: b52e58fe-0ca0-47f5-9824-8edd6509d2ee] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:15.168436 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3890d788-2b10-493e-8724-5671c7c9708a tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:15.169525 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3890d788-2b10-493e-8724-5671c7c9708a tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:15.170246 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3890d788-2b10-493e-8724-5671c7c9708a tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:15.171774 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3890d788-2b10-493e-8724-5671c7c9708a tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:15.173345 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3890d788-2b10-493e-8724-5671c7c9708a tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:15.173852 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3890d788-2b10-493e-8724-5671c7c9708a tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:15.205435 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:15.387343 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-3890d788-2b10-493e-8724-5671c7c9708a tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87689334264c4a939367f091ccfbd642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8bd6fe9ca418d9e295aa3f419f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:15.399427 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-3890d788-2b10-493e-8724-5671c7c9708a tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] 10.222.0.27 "GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee" status: 200 len: 1314 microversion: 2.1 time: 0.243541 Aug 09 11:19:15.400558 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 95/185] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:15 2022] GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:19:15.802650 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-9244f233-c5b3-458b-aa62-75aa8d6891f8 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:15.803845 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-9244f233-c5b3-458b-aa62-75aa8d6891f8 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] [instance: e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:15.810231 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9244f233-c5b3-458b-aa62-75aa8d6891f8 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:15.810932 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9244f233-c5b3-458b-aa62-75aa8d6891f8 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:15.811513 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9244f233-c5b3-458b-aa62-75aa8d6891f8 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:15.812394 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9244f233-c5b3-458b-aa62-75aa8d6891f8 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:15.812988 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9244f233-c5b3-458b-aa62-75aa8d6891f8 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:15.813584 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9244f233-c5b3-458b-aa62-75aa8d6891f8 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:15.872755 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [req-e3b38459-5ac7-4e64-ac1f-5fbb5e708adf req-d6b7b67c-4406-44f7-a074-857204291444 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6", "tag": "8ad2a45f-c0fc-45c0-a513-75b8c6eecec7"}]} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:19:15.891228 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-e3b38459-5ac7-4e64-ac1f-5fbb5e708adf req-d6b7b67c-4406-44f7-a074-857204291444 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:15.892560 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-e3b38459-5ac7-4e64-ac1f-5fbb5e708adf req-d6b7b67c-4406-44f7-a074-857204291444 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:15.896054 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-e3b38459-5ac7-4e64-ac1f-5fbb5e708adf req-d6b7b67c-4406-44f7-a074-857204291444 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:15.916850 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.compute.server_external_events [req-e3b38459-5ac7-4e64-ac1f-5fbb5e708adf req-d6b7b67c-4406-44f7-a074-857204291444 service nova] Creating event network-changed:8ad2a45f-c0fc-45c0-a513-75b8c6eecec7 for instance e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6 on hv-cinder-85251 Aug 09 11:19:15.937531 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [req-e3b38459-5ac7-4e64-ac1f-5fbb5e708adf req-d6b7b67c-4406-44f7-a074-857204291444 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069418 Aug 09 11:19:15.938315 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 96/186] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:19:16.159602 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-9244f233-c5b3-458b-aa62-75aa8d6891f8 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c011df2b144f758dd286e77875bcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37fc7dacc11483ca9c6f047d3bd2553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:16.176943 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-9244f233-c5b3-458b-aa62-75aa8d6891f8 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] 10.222.0.27 "GET /compute/v2.1/servers/e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6" status: 200 len: 1312 microversion: 2.1 time: 0.378196 Aug 09 11:19:16.177605 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 91/187] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:15 2022] GET /compute/v2.1/servers/e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6 => generated 1312 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:16.423404 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-b8ed7b48-336b-4249-93e2-856d9b0db443 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:16.424162 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-b8ed7b48-336b-4249-93e2-856d9b0db443 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] [instance: b52e58fe-0ca0-47f5-9824-8edd6509d2ee] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:16.434299 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b8ed7b48-336b-4249-93e2-856d9b0db443 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:16.434709 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b8ed7b48-336b-4249-93e2-856d9b0db443 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:16.435144 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b8ed7b48-336b-4249-93e2-856d9b0db443 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:16.435850 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b8ed7b48-336b-4249-93e2-856d9b0db443 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:16.437360 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b8ed7b48-336b-4249-93e2-856d9b0db443 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:16.437807 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b8ed7b48-336b-4249-93e2-856d9b0db443 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:16.789455 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-b8ed7b48-336b-4249-93e2-856d9b0db443 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87689334264c4a939367f091ccfbd642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8bd6fe9ca418d9e295aa3f419f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:16.798800 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-b8ed7b48-336b-4249-93e2-856d9b0db443 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] 10.222.0.27 "GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee" status: 200 len: 1463 microversion: 2.1 time: 0.379803 Aug 09 11:19:16.812415 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 97/188] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:16 2022] GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee => generated 1463 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:16.881052 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-31308ef3-dcdc-4dca-b6aa-104b156a3691 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:16.882271 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-31308ef3-dcdc-4dca-b6aa-104b156a3691 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] [instance: b52e58fe-0ca0-47f5-9824-8edd6509d2ee] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:16.897464 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-31308ef3-dcdc-4dca-b6aa-104b156a3691 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:16.899130 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-31308ef3-dcdc-4dca-b6aa-104b156a3691 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:16.908220 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-31308ef3-dcdc-4dca-b6aa-104b156a3691 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:16.917930 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-31308ef3-dcdc-4dca-b6aa-104b156a3691 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:16.919231 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-31308ef3-dcdc-4dca-b6aa-104b156a3691 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:16.919830 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-31308ef3-dcdc-4dca-b6aa-104b156a3691 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:16.962920 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-31308ef3-dcdc-4dca-b6aa-104b156a3691 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] [instance: b52e58fe-0ca0-47f5-9824-8edd6509d2ee] Going to try to terminate instance {{(pid=117685) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 11:19:17.075165 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-31308ef3-dcdc-4dca-b6aa-104b156a3691 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee" status: 204 len: 0 microversion: 2.1 time: 0.196090 Aug 09 11:19:17.077841 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 92/189] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 9 11:19:16 2022] DELETE /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 11:19:17.087146 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-310ef643-2b26-42f2-9b93-2845c9f9d19d tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:17.088007 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-310ef643-2b26-42f2-9b93-2845c9f9d19d tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] [instance: b52e58fe-0ca0-47f5-9824-8edd6509d2ee] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:17.094877 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-310ef643-2b26-42f2-9b93-2845c9f9d19d tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:17.095633 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-310ef643-2b26-42f2-9b93-2845c9f9d19d tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:17.096124 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-310ef643-2b26-42f2-9b93-2845c9f9d19d tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:17.096959 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-310ef643-2b26-42f2-9b93-2845c9f9d19d tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:17.098243 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-310ef643-2b26-42f2-9b93-2845c9f9d19d tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:17.098675 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-310ef643-2b26-42f2-9b93-2845c9f9d19d tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:17.200049 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-2b3f52f8-2caf-4246-bf76-129784fef645 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:17.201628 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-2b3f52f8-2caf-4246-bf76-129784fef645 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] [instance: e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:17.210694 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2b3f52f8-2caf-4246-bf76-129784fef645 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:17.211350 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2b3f52f8-2caf-4246-bf76-129784fef645 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:17.211886 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2b3f52f8-2caf-4246-bf76-129784fef645 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:17.212802 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2b3f52f8-2caf-4246-bf76-129784fef645 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:17.213373 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2b3f52f8-2caf-4246-bf76-129784fef645 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:17.214100 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2b3f52f8-2caf-4246-bf76-129784fef645 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:17.432473 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-310ef643-2b26-42f2-9b93-2845c9f9d19d tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87689334264c4a939367f091ccfbd642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8bd6fe9ca418d9e295aa3f419f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:17.441690 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-310ef643-2b26-42f2-9b93-2845c9f9d19d tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] 10.222.0.27 "GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee" status: 200 len: 1469 microversion: 2.1 time: 0.358577 Aug 09 11:19:17.442841 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 98/190] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:17 2022] GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee => generated 1469 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:17.465425 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-2b3f52f8-2caf-4246-bf76-129784fef645 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c011df2b144f758dd286e77875bcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37fc7dacc11483ca9c6f047d3bd2553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:17.475073 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-2b3f52f8-2caf-4246-bf76-129784fef645 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] 10.222.0.27 "GET /compute/v2.1/servers/e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6" status: 200 len: 1312 microversion: 2.1 time: 0.280399 Aug 09 11:19:17.482597 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 93/191] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:17 2022] GET /compute/v2.1/servers/e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6 => generated 1312 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:19:18.464214 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-9c6f19ba-7631-48d7-a96e-12adfd7cfe76 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:18.466420 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-9c6f19ba-7631-48d7-a96e-12adfd7cfe76 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] [instance: b52e58fe-0ca0-47f5-9824-8edd6509d2ee] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:18.480594 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9c6f19ba-7631-48d7-a96e-12adfd7cfe76 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:18.481133 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9c6f19ba-7631-48d7-a96e-12adfd7cfe76 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:18.481794 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9c6f19ba-7631-48d7-a96e-12adfd7cfe76 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:18.486281 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9c6f19ba-7631-48d7-a96e-12adfd7cfe76 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:18.487241 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9c6f19ba-7631-48d7-a96e-12adfd7cfe76 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:18.487675 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9c6f19ba-7631-48d7-a96e-12adfd7cfe76 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:18.498179 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-4257bc00-b688-4d7c-969e-89e54fc831ab tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:18.499087 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-4257bc00-b688-4d7c-969e-89e54fc831ab tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] [instance: e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:18.508208 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4257bc00-b688-4d7c-969e-89e54fc831ab tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:18.508924 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4257bc00-b688-4d7c-969e-89e54fc831ab tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:18.509444 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4257bc00-b688-4d7c-969e-89e54fc831ab tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:18.510971 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4257bc00-b688-4d7c-969e-89e54fc831ab tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:18.511758 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4257bc00-b688-4d7c-969e-89e54fc831ab tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:18.512692 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4257bc00-b688-4d7c-969e-89e54fc831ab tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:18.972658 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-9c6f19ba-7631-48d7-a96e-12adfd7cfe76 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87689334264c4a939367f091ccfbd642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8bd6fe9ca418d9e295aa3f419f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:18.982364 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-4257bc00-b688-4d7c-969e-89e54fc831ab tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c011df2b144f758dd286e77875bcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37fc7dacc11483ca9c6f047d3bd2553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:18.997349 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-4257bc00-b688-4d7c-969e-89e54fc831ab tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] 10.222.0.27 "GET /compute/v2.1/servers/e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6" status: 200 len: 1312 microversion: 2.1 time: 0.505280 Aug 09 11:19:19.000893 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-9c6f19ba-7631-48d7-a96e-12adfd7cfe76 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] 10.222.0.27 "GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee" status: 200 len: 1469 microversion: 2.1 time: 0.541673 Aug 09 11:19:19.001934 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 99/192] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:18 2022] GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee => generated 1469 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:19.002920 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 94/193] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:18 2022] GET /compute/v2.1/servers/e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6 => generated 1312 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:19:20.031172 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-acf3c69f-cddb-4766-8ed5-4c1c022984dc tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:20.034867 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-febb7983-9404-4fdc-8939-a6b419a88007 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:20.036076 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-febb7983-9404-4fdc-8939-a6b419a88007 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] [instance: e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:20.036439 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-acf3c69f-cddb-4766-8ed5-4c1c022984dc tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] [instance: b52e58fe-0ca0-47f5-9824-8edd6509d2ee] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:20.054258 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-febb7983-9404-4fdc-8939-a6b419a88007 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:20.054498 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-acf3c69f-cddb-4766-8ed5-4c1c022984dc tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:20.055150 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-acf3c69f-cddb-4766-8ed5-4c1c022984dc tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:20.055724 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-febb7983-9404-4fdc-8939-a6b419a88007 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:20.056758 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-acf3c69f-cddb-4766-8ed5-4c1c022984dc tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:20.057316 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-febb7983-9404-4fdc-8939-a6b419a88007 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:20.058705 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-febb7983-9404-4fdc-8939-a6b419a88007 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:20.059339 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-acf3c69f-cddb-4766-8ed5-4c1c022984dc tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:20.060673 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-acf3c69f-cddb-4766-8ed5-4c1c022984dc tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:20.061384 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-febb7983-9404-4fdc-8939-a6b419a88007 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:20.062662 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-acf3c69f-cddb-4766-8ed5-4c1c022984dc tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:20.063834 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-febb7983-9404-4fdc-8939-a6b419a88007 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:20.255913 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-acf3c69f-cddb-4766-8ed5-4c1c022984dc tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87689334264c4a939367f091ccfbd642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df8bd6fe9ca418d9e295aa3f419f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:20.266113 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-acf3c69f-cddb-4766-8ed5-4c1c022984dc tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] 10.222.0.27 "GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee" status: 200 len: 1427 microversion: 2.1 time: 0.243047 Aug 09 11:19:20.266705 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 100/194] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:20 2022] GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee => generated 1427 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:20.283264 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [req-7762733c-3af7-46cd-86b8-81ec68a79d7e req-aad55557-28dc-4d80-8551-a8a1d96903fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b52e58fe-0ca0-47f5-9824-8edd6509d2ee", "name": "network-vif-deleted", "tag": "a0e1df8f-6c5d-403e-b534-35078a35e14f"}]} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:19:20.313462 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-7762733c-3af7-46cd-86b8-81ec68a79d7e req-aad55557-28dc-4d80-8551-a8a1d96903fb service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:20.314066 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-7762733c-3af7-46cd-86b8-81ec68a79d7e req-aad55557-28dc-4d80-8551-a8a1d96903fb service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:20.318863 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-7762733c-3af7-46cd-86b8-81ec68a79d7e req-aad55557-28dc-4d80-8551-a8a1d96903fb service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:20.335062 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.compute.server_external_events [req-7762733c-3af7-46cd-86b8-81ec68a79d7e req-aad55557-28dc-4d80-8551-a8a1d96903fb service nova] Creating event network-vif-deleted:a0e1df8f-6c5d-403e-b534-35078a35e14f for instance b52e58fe-0ca0-47f5-9824-8edd6509d2ee on hv-cinder-85251 Aug 09 11:19:20.345898 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [req-7762733c-3af7-46cd-86b8-81ec68a79d7e req-aad55557-28dc-4d80-8551-a8a1d96903fb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064091 Aug 09 11:19:20.347100 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 101/195] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:19:20.430142 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-febb7983-9404-4fdc-8939-a6b419a88007 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c011df2b144f758dd286e77875bcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37fc7dacc11483ca9c6f047d3bd2553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:20.443233 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-febb7983-9404-4fdc-8939-a6b419a88007 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] 10.222.0.27 "GET /compute/v2.1/servers/e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6" status: 200 len: 1312 microversion: 2.1 time: 0.419985 Aug 09 11:19:20.444677 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 95/196] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:20 2022] GET /compute/v2.1/servers/e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6 => generated 1312 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:19:21.197041 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-9b5b8e06-a27c-4728-b476-22540927f70d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1641288523", "imageRef": "2321e9a0-fe0f-47fd-9c4b-8868eb5a00af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:19:21.252956 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.network.neutron [None req-9b5b8e06-a27c-4728-b476-22540927f70d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] validate_networks() for [('12e0a510-22d0-41f2-a60e-16ee2de67eb5', None, None, None, None, None)] {{(pid=117684) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 11:19:21.287798 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-80a94d28-5e5a-44e1-bfa8-796752c0b614 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:21.291501 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-80a94d28-5e5a-44e1-bfa8-796752c0b614 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] [instance: b52e58fe-0ca0-47f5-9824-8edd6509d2ee] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:21.297789 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-80a94d28-5e5a-44e1-bfa8-796752c0b614 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:21.298269 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-80a94d28-5e5a-44e1-bfa8-796752c0b614 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:21.298904 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-80a94d28-5e5a-44e1-bfa8-796752c0b614 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:21.299848 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-80a94d28-5e5a-44e1-bfa8-796752c0b614 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:21.300531 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-80a94d28-5e5a-44e1-bfa8-796752c0b614 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:21.301095 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-80a94d28-5e5a-44e1-bfa8-796752c0b614 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:21.328623 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.wsgi [None req-80a94d28-5e5a-44e1-bfa8-796752c0b614 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] HTTP exception thrown: Instance b52e58fe-0ca0-47f5-9824-8edd6509d2ee could not be found. Aug 09 11:19:21.330862 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-80a94d28-5e5a-44e1-bfa8-796752c0b614 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Request method failure captured: Aug 09 11:19:21.330862 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: request: GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee HTTP/1.1 Aug 09 11:19:21.330862 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Accept: application/json Aug 09 11:19:21.330862 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Accept-Encoding: identity Aug 09 11:19:21.330862 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Connection: close Aug 09 11:19:21.330862 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Content-Length: 0 Aug 09 11:19:21.330862 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Content-Type: application/json Aug 09 11:19:21.330862 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Host: 10.222.0.27 Aug 09 11:19:21.330862 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Openstack-System-Scope: None Aug 09 11:19:21.330862 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: User-Agent: python-urllib3/1.26.11 Aug 09 11:19:21.330862 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Auth-Token: gAAAAABi8kKXcnVPvUrPWjEEeNJbJD57SRKLCbL_RvFUkWpTydoPPxhdNzKY9plzIl_PvTDkO01o-smeHiIjijweayHbhZV8RYV8pheYXO0tbFFFMdn_6box8wqiuX3DTzOHkT9dmqcL5MeYso1M6tk57AayTl_ikoypNC4pTsQkMEyy7OpqX0w Aug 09 11:19:21.330862 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Domain-Id: None Aug 09 11:19:21.330862 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Domain-Name: None Aug 09 11:19:21.330862 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Identity-Status: Confirmed Aug 09 11:19:21.330862 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Is-Admin-Project: True Aug 09 11:19:21.330862 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Domain-Id: default Aug 09 11:19:21.330862 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Domain-Name: Default Aug 09 11:19:21.330862 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Id: 0df8bd6fe9ca418d9e295aa3f419f5de Aug 09 11:19:21.330862 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Name: tempest-VolumesNegativeTest-192953781 Aug 09 11:19:21.330862 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Role: member,reader Aug 09 11:19:21.330862 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Roles: member,reader Aug 09 11:19:21.332370 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0df8bd6fe9ca418d9e295aa3f419f5de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0df8bd6fe9ca418d9e295aa3f419f5de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0df8bd6fe9ca418d9e295aa3f419f5de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0df8bd6fe9ca418d9e295aa3f419f5de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:19:21.332370 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant: tempest-VolumesNegativeTest-192953781 Aug 09 11:19:21.332370 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant-Id: 0df8bd6fe9ca418d9e295aa3f419f5de Aug 09 11:19:21.332370 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant-Name: tempest-VolumesNegativeTest-192953781 Aug 09 11:19:21.332370 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User: tempest-VolumesNegativeTest-192953781-project Aug 09 11:19:21.332370 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Domain-Id: default Aug 09 11:19:21.332370 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Domain-Name: Default Aug 09 11:19:21.332370 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Id: 87689334264c4a939367f091ccfbd642 Aug 09 11:19:21.332370 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Name: tempest-VolumesNegativeTest-192953781-project Aug 09 11:19:21.332370 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: method: > Aug 09 11:19:21.332370 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: exception: Instance b52e58fe-0ca0-47f5-9824-8edd6509d2ee could not be found. Aug 09 11:19:21.332370 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: action_args: {'id': 'b52e58fe-0ca0-47f5-9824-8edd6509d2ee'} Aug 09 11:19:21.333179 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:19:21.333179 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:19:21.333179 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:19:21.333179 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:19:21.333179 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:19:21.333179 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:19:21.333179 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:19:21.333179 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:19:21.333179 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:19:21.333179 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:19:21.333179 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b52e58fe-0ca0-47f5-9824-8edd6509d2ee could not be found. Aug 09 11:19:21.333179 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:19:21.333179 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:19:21.333179 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:19:21.333179 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:19:21.333179 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:19:21.333179 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:19:21.333179 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:19:21.333179 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:19:21.333179 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:19:21.334355 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:19:21.334355 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:19:21.334355 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:19:21.334355 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:19:21.334355 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:19:21.334355 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:19:21.334355 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:19:21.334355 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b52e58fe-0ca0-47f5-9824-8edd6509d2ee could not be found. Aug 09 11:19:21.334355 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:19:21.334355 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:19:21.334355 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:19:21.334355 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:19:21.334355 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:19:21.334355 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:19:21.334355 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:19:21.334355 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:19:21.334355 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b52e58fe-0ca0-47f5-9824-8edd6509d2ee could not be found. Aug 09 11:19:21.334355 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:19:21.336539 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-80a94d28-5e5a-44e1-bfa8-796752c0b614 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] Returning 404 to user: Instance b52e58fe-0ca0-47f5-9824-8edd6509d2ee could not be found. {{(pid=117685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:19:21.338767 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-80a94d28-5e5a-44e1-bfa8-796752c0b614 tempest-VolumesNegativeTest-192953781 tempest-VolumesNegativeTest-192953781-project] 10.222.0.27 "GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee" status: 404 len: 111 microversion: 2.1 time: 0.055383 Aug 09 11:19:21.344204 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 96/197] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:21 2022] GET /compute/v2.1/servers/b52e58fe-0ca0-47f5-9824-8edd6509d2ee => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 11:19:21.466504 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-640c8c2a-9c84-4c3c-b610-90e4f9c72faa tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:21.468059 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-640c8c2a-9c84-4c3c-b610-90e4f9c72faa tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] [instance: e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:21.475230 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-640c8c2a-9c84-4c3c-b610-90e4f9c72faa tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:21.476934 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-640c8c2a-9c84-4c3c-b610-90e4f9c72faa tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:21.477638 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-640c8c2a-9c84-4c3c-b610-90e4f9c72faa tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:21.478570 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-640c8c2a-9c84-4c3c-b610-90e4f9c72faa tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:21.479229 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-640c8c2a-9c84-4c3c-b610-90e4f9c72faa tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:21.479973 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-640c8c2a-9c84-4c3c-b610-90e4f9c72faa tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:21.994722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-640c8c2a-9c84-4c3c-b610-90e4f9c72faa tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c011df2b144f758dd286e77875bcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37fc7dacc11483ca9c6f047d3bd2553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:22.009906 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-640c8c2a-9c84-4c3c-b610-90e4f9c72faa tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] 10.222.0.27 "GET /compute/v2.1/servers/e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6" status: 200 len: 1312 microversion: 2.1 time: 0.548118 Aug 09 11:19:22.014071 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 97/198] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:21 2022] GET /compute/v2.1/servers/e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6 => generated 1312 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:19:22.022682 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-bfb2ddb2-bad7-4fe7-926b-962f106c1f31 req-998657a1-db22-4005-893f-5e6bc422d175 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6", "name": "network-vif-plugged", "status": "completed", "tag": "8ad2a45f-c0fc-45c0-a513-75b8c6eecec7"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:19:22.041247 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-bfb2ddb2-bad7-4fe7-926b-962f106c1f31 req-998657a1-db22-4005-893f-5e6bc422d175 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:22.041961 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-bfb2ddb2-bad7-4fe7-926b-962f106c1f31 req-998657a1-db22-4005-893f-5e6bc422d175 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:22.042762 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-bfb2ddb2-bad7-4fe7-926b-962f106c1f31 req-998657a1-db22-4005-893f-5e6bc422d175 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:22.053140 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-9b5b8e06-a27c-4728-b476-22540927f70d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Flavor limits 0:0:0 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 11:19:22.054083 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-9b5b8e06-a27c-4728-b476-22540927f70d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Image limits 0:0:0 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 11:19:22.054707 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-9b5b8e06-a27c-4728-b476-22540927f70d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Flavor pref 0:0:0 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 11:19:22.055256 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-9b5b8e06-a27c-4728-b476-22540927f70d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Image pref 0:0:0 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 11:19:22.055805 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-9b5b8e06-a27c-4728-b476-22540927f70d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 11:19:22.077200 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9b5b8e06-a27c-4728-b476-22540927f70d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:22.077844 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9b5b8e06-a27c-4728-b476-22540927f70d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:22.078440 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9b5b8e06-a27c-4728-b476-22540927f70d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:22.080479 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9b5b8e06-a27c-4728-b476-22540927f70d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:22.081586 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9b5b8e06-a27c-4728-b476-22540927f70d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:22.084064 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-bfb2ddb2-bad7-4fe7-926b-962f106c1f31 req-998657a1-db22-4005-893f-5e6bc422d175 service nova] Creating event network-vif-plugged:8ad2a45f-c0fc-45c0-a513-75b8c6eecec7 for instance e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6 on hv-cinder-85251 Aug 09 11:19:22.085259 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9b5b8e06-a27c-4728-b476-22540927f70d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:22.100760 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-bfb2ddb2-bad7-4fe7-926b-962f106c1f31 req-998657a1-db22-4005-893f-5e6bc422d175 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083103 Aug 09 11:19:22.101419 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 98/199] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:19:22.126706 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.quota [None req-9b5b8e06-a27c-4728-b476-22540927f70d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Getting quotas for project 45bb3a603ddc4d3b8042b6ae687c896e. Resources: {'cores', 'instances', 'ram'} {{(pid=117684) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:19:22.136784 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.quota [None req-9b5b8e06-a27c-4728-b476-22540927f70d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Getting quotas for user 3a1cd35a257f4b0f99141580c14bad48 and project 45bb3a603ddc4d3b8042b6ae687c896e. Resources: {'cores', 'instances', 'ram'} {{(pid=117684) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:19:22.168214 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-9b5b8e06-a27c-4728-b476-22540927f70d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Going to run 1 instances... {{(pid=117684) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 11:19:22.172715 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-9b5b8e06-a27c-4728-b476-22540927f70d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2321e9a0-fe0f-47fd-9c4b-8868eb5a00af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117684) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 11:19:22.261067 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-9b5b8e06-a27c-4728-b476-22540927f70d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.325449 Aug 09 11:19:22.267263 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 102/200] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 9 11:19:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 1328 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 11:19:22.270002 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell0:SELECT=2 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:22.273863 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell0:SELECT=6 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:22.286917 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-8e88203d-9328-4531-80b3-dbb7aef413a7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:22.287593 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-8e88203d-9328-4531-80b3-dbb7aef413a7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:22.431248 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-8e88203d-9328-4531-80b3-dbb7aef413a7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:22.440044 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-8e88203d-9328-4531-80b3-dbb7aef413a7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1222 microversion: 2.1 time: 0.169893 Aug 09 11:19:22.456350 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 99/201] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:22 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1222 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:22.621249 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-87e22ca9-a6d3-469a-8a71-dee5d4aff070 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1055326444", "imageRef": "2321e9a0-fe0f-47fd-9c4b-8868eb5a00af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:19:22.641074 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:22.716964 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.network.neutron [None req-87e22ca9-a6d3-469a-8a71-dee5d4aff070 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] validate_networks() for [('12e0a510-22d0-41f2-a60e-16ee2de67eb5', None, None, None, None, None)] {{(pid=117684) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 11:19:23.036397 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-cb362207-8199-4a4c-afd8-df8c7521f074 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:23.037655 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-cb362207-8199-4a4c-afd8-df8c7521f074 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] [instance: e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:23.048508 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-cb362207-8199-4a4c-afd8-df8c7521f074 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:23.049261 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-cb362207-8199-4a4c-afd8-df8c7521f074 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:23.049936 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-cb362207-8199-4a4c-afd8-df8c7521f074 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:23.050938 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-cb362207-8199-4a4c-afd8-df8c7521f074 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:23.051582 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-cb362207-8199-4a4c-afd8-df8c7521f074 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:23.052072 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-cb362207-8199-4a4c-afd8-df8c7521f074 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:23.308626 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-87e22ca9-a6d3-469a-8a71-dee5d4aff070 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Flavor limits 0:0:0 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 11:19:23.309133 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-87e22ca9-a6d3-469a-8a71-dee5d4aff070 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Image limits 0:0:0 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 11:19:23.309810 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-87e22ca9-a6d3-469a-8a71-dee5d4aff070 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Flavor pref 0:0:0 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 11:19:23.310215 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-87e22ca9-a6d3-469a-8a71-dee5d4aff070 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Image pref 0:0:0 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 11:19:23.310697 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-87e22ca9-a6d3-469a-8a71-dee5d4aff070 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 11:19:23.319067 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-cb362207-8199-4a4c-afd8-df8c7521f074 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c011df2b144f758dd286e77875bcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37fc7dacc11483ca9c6f047d3bd2553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:23.335514 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-cb362207-8199-4a4c-afd8-df8c7521f074 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] 10.222.0.27 "GET /compute/v2.1/servers/e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6" status: 200 len: 1312 microversion: 2.1 time: 0.304142 Aug 09 11:19:23.338124 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 100/202] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:23 2022] GET /compute/v2.1/servers/e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6 => generated 1312 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:23.343349 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-87e22ca9-a6d3-469a-8a71-dee5d4aff070 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:23.344367 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-87e22ca9-a6d3-469a-8a71-dee5d4aff070 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:23.345017 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-87e22ca9-a6d3-469a-8a71-dee5d4aff070 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:23.346084 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-87e22ca9-a6d3-469a-8a71-dee5d4aff070 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:23.348073 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-87e22ca9-a6d3-469a-8a71-dee5d4aff070 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:23.348748 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-87e22ca9-a6d3-469a-8a71-dee5d4aff070 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:23.372391 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.quota [None req-87e22ca9-a6d3-469a-8a71-dee5d4aff070 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Getting quotas for project 45bb3a603ddc4d3b8042b6ae687c896e. Resources: {'cores', 'instances', 'ram'} {{(pid=117684) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:19:23.377876 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.quota [None req-87e22ca9-a6d3-469a-8a71-dee5d4aff070 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Getting quotas for user 3a1cd35a257f4b0f99141580c14bad48 and project 45bb3a603ddc4d3b8042b6ae687c896e. Resources: {'cores', 'instances', 'ram'} {{(pid=117684) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:19:23.403535 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-87e22ca9-a6d3-469a-8a71-dee5d4aff070 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Going to run 1 instances... {{(pid=117684) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 11:19:23.405846 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-87e22ca9-a6d3-469a-8a71-dee5d4aff070 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2321e9a0-fe0f-47fd-9c4b-8868eb5a00af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117684) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 11:19:23.471981 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-87e22ca9-a6d3-469a-8a71-dee5d4aff070 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.854962 Aug 09 11:19:23.473340 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 103/203] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 9 11:19:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 11:19:23.484082 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-20c87e60-34a2-4429-a7b6-9d1d5da8b0c0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:23.485647 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-20c87e60-34a2-4429-a7b6-9d1d5da8b0c0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:23.588496 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-20c87e60-34a2-4429-a7b6-9d1d5da8b0c0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:23.609310 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-20c87e60-34a2-4429-a7b6-9d1d5da8b0c0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697" status: 200 len: 1222 microversion: 2.1 time: 0.128253 Aug 09 11:19:23.610944 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 101/204] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:23 2022] GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697 => generated 1222 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:24.358579 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-6d47fd8d-de89-41e7-9e74-f6fb434338db tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:24.359336 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-6d47fd8d-de89-41e7-9e74-f6fb434338db tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] [instance: e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:24.366297 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6d47fd8d-de89-41e7-9e74-f6fb434338db tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:24.366872 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6d47fd8d-de89-41e7-9e74-f6fb434338db tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:24.367484 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6d47fd8d-de89-41e7-9e74-f6fb434338db tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:24.368259 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6d47fd8d-de89-41e7-9e74-f6fb434338db tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:24.368828 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6d47fd8d-de89-41e7-9e74-f6fb434338db tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:24.369337 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6d47fd8d-de89-41e7-9e74-f6fb434338db tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:24.530389 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-6d47fd8d-de89-41e7-9e74-f6fb434338db tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c011df2b144f758dd286e77875bcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37fc7dacc11483ca9c6f047d3bd2553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:24.540841 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-6d47fd8d-de89-41e7-9e74-f6fb434338db tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] 10.222.0.27 "GET /compute/v2.1/servers/e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6" status: 200 len: 1496 microversion: 2.1 time: 0.186121 Aug 09 11:19:24.542546 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 104/205] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:24 2022] GET /compute/v2.1/servers/e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6 => generated 1496 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:24.635174 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-b9ccf77a-229e-4868-9a06-447ab8a10776 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:24.636444 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-b9ccf77a-229e-4868-9a06-447ab8a10776 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:24.647280 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b9ccf77a-229e-4868-9a06-447ab8a10776 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:24.647878 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b9ccf77a-229e-4868-9a06-447ab8a10776 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:24.650933 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b9ccf77a-229e-4868-9a06-447ab8a10776 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:24.651844 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b9ccf77a-229e-4868-9a06-447ab8a10776 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:24.655426 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b9ccf77a-229e-4868-9a06-447ab8a10776 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:24.655865 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b9ccf77a-229e-4868-9a06-447ab8a10776 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:24.798411 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-b9ccf77a-229e-4868-9a06-447ab8a10776 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:24.807904 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-b9ccf77a-229e-4868-9a06-447ab8a10776 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697" status: 200 len: 1218 microversion: 2.1 time: 0.178161 Aug 09 11:19:24.808585 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 102/206] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:24 2022] GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697 => generated 1218 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:25.342490 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-3cf4740f-bb5b-43c7-a1b9-23892a4b6d3e tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:25.342996 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-3cf4740f-bb5b-43c7-a1b9-23892a4b6d3e tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] [instance: e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:25.350014 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3cf4740f-bb5b-43c7-a1b9-23892a4b6d3e tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:25.350511 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3cf4740f-bb5b-43c7-a1b9-23892a4b6d3e tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:25.351020 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3cf4740f-bb5b-43c7-a1b9-23892a4b6d3e tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:25.357358 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3cf4740f-bb5b-43c7-a1b9-23892a4b6d3e tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:25.357880 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3cf4740f-bb5b-43c7-a1b9-23892a4b6d3e tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:25.358329 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3cf4740f-bb5b-43c7-a1b9-23892a4b6d3e tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:25.438220 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-3cf4740f-bb5b-43c7-a1b9-23892a4b6d3e tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] [instance: e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6] Going to try to terminate instance {{(pid=117684) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 11:19:25.641701 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-3cf4740f-bb5b-43c7-a1b9-23892a4b6d3e tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6" status: 204 len: 0 microversion: 2.1 time: 0.303162 Aug 09 11:19:25.642534 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 105/207] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 9 11:19:25 2022] DELETE /compute/v2.1/servers/e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 11:19:25.652197 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-e7218d68-52af-4b09-b1b4-5201e7214cee tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:25.653285 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-e7218d68-52af-4b09-b1b4-5201e7214cee tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] [instance: e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:25.662982 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e7218d68-52af-4b09-b1b4-5201e7214cee tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:25.663477 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e7218d68-52af-4b09-b1b4-5201e7214cee tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:25.663900 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e7218d68-52af-4b09-b1b4-5201e7214cee tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:25.667126 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e7218d68-52af-4b09-b1b4-5201e7214cee tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:25.668822 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e7218d68-52af-4b09-b1b4-5201e7214cee tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:25.670064 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e7218d68-52af-4b09-b1b4-5201e7214cee tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:25.828588 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-503254f1-161e-4672-b24d-b57dec2ed976 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:25.829856 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-503254f1-161e-4672-b24d-b57dec2ed976 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:25.841495 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-503254f1-161e-4672-b24d-b57dec2ed976 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:25.843591 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-503254f1-161e-4672-b24d-b57dec2ed976 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:25.844222 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-503254f1-161e-4672-b24d-b57dec2ed976 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:25.846346 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-503254f1-161e-4672-b24d-b57dec2ed976 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:25.847611 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-503254f1-161e-4672-b24d-b57dec2ed976 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:25.847944 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-503254f1-161e-4672-b24d-b57dec2ed976 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:25.888040 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-e7218d68-52af-4b09-b1b4-5201e7214cee tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c011df2b144f758dd286e77875bcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37fc7dacc11483ca9c6f047d3bd2553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:25.898743 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-e7218d68-52af-4b09-b1b4-5201e7214cee tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] 10.222.0.27 "GET /compute/v2.1/servers/e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6" status: 200 len: 1502 microversion: 2.1 time: 0.250787 Aug 09 11:19:25.922710 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 103/208] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:25 2022] GET /compute/v2.1/servers/e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6 => generated 1502 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:26.017564 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-503254f1-161e-4672-b24d-b57dec2ed976 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:26.041001 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-503254f1-161e-4672-b24d-b57dec2ed976 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697" status: 200 len: 1280 microversion: 2.1 time: 0.206543 Aug 09 11:19:26.042135 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 106/209] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:25 2022] GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697 => generated 1280 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:19:26.923300 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-444306e8-8579-43f6-991c-589ad056832a tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:26.924463 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-444306e8-8579-43f6-991c-589ad056832a tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] [instance: e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:26.933835 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-444306e8-8579-43f6-991c-589ad056832a tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:26.934301 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-444306e8-8579-43f6-991c-589ad056832a tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:26.935451 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-444306e8-8579-43f6-991c-589ad056832a tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:26.936787 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-444306e8-8579-43f6-991c-589ad056832a tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:26.937211 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-444306e8-8579-43f6-991c-589ad056832a tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:26.938146 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-444306e8-8579-43f6-991c-589ad056832a tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:27.062005 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-f9f41e26-a4d1-418f-bf73-597c02ecf072 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:27.062608 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-f9f41e26-a4d1-418f-bf73-597c02ecf072 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:27.069476 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f9f41e26-a4d1-418f-bf73-597c02ecf072 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:27.070189 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f9f41e26-a4d1-418f-bf73-597c02ecf072 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:27.070769 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f9f41e26-a4d1-418f-bf73-597c02ecf072 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:27.071641 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f9f41e26-a4d1-418f-bf73-597c02ecf072 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:27.072227 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f9f41e26-a4d1-418f-bf73-597c02ecf072 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:27.072939 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f9f41e26-a4d1-418f-bf73-597c02ecf072 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:27.081683 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-444306e8-8579-43f6-991c-589ad056832a tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c011df2b144f758dd286e77875bcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37fc7dacc11483ca9c6f047d3bd2553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:27.089854 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-444306e8-8579-43f6-991c-589ad056832a tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] 10.222.0.27 "GET /compute/v2.1/servers/e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6" status: 200 len: 1502 microversion: 2.1 time: 0.171127 Aug 09 11:19:27.090565 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 104/210] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:26 2022] GET /compute/v2.1/servers/e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6 => generated 1502 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:27.143307 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-f9f41e26-a4d1-418f-bf73-597c02ecf072 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:27.152071 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-f9f41e26-a4d1-418f-bf73-597c02ecf072 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697" status: 200 len: 1280 microversion: 2.1 time: 0.093882 Aug 09 11:19:27.152702 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 107/211] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:27 2022] GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697 => generated 1280 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:19:28.116159 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-b4098906-b502-427e-9cd5-2b7d7ecc8121 req-f4cf68c0-4def-4c81-9f5a-058ffc1220da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6", "name": "network-vif-deleted", "tag": "8ad2a45f-c0fc-45c0-a513-75b8c6eecec7"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:19:28.124784 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-734b3bf0-98d4-44d2-a115-346373551ff8 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:28.126512 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-734b3bf0-98d4-44d2-a115-346373551ff8 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] [instance: e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:28.140767 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-734b3bf0-98d4-44d2-a115-346373551ff8 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:28.149500 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-734b3bf0-98d4-44d2-a115-346373551ff8 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:28.151993 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-734b3bf0-98d4-44d2-a115-346373551ff8 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:28.155121 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-734b3bf0-98d4-44d2-a115-346373551ff8 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:28.156132 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-734b3bf0-98d4-44d2-a115-346373551ff8 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:28.157632 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-b4098906-b502-427e-9cd5-2b7d7ecc8121 req-f4cf68c0-4def-4c81-9f5a-058ffc1220da service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:28.158191 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-734b3bf0-98d4-44d2-a115-346373551ff8 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:28.160065 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-b4098906-b502-427e-9cd5-2b7d7ecc8121 req-f4cf68c0-4def-4c81-9f5a-058ffc1220da service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:28.161612 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-b4098906-b502-427e-9cd5-2b7d7ecc8121 req-f4cf68c0-4def-4c81-9f5a-058ffc1220da service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:28.209773 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-b4098906-b502-427e-9cd5-2b7d7ecc8121 req-f4cf68c0-4def-4c81-9f5a-058ffc1220da service nova] Creating event network-vif-deleted:8ad2a45f-c0fc-45c0-a513-75b8c6eecec7 for instance e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6 on hv-cinder-85251 Aug 09 11:19:28.231542 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-b4098906-b502-427e-9cd5-2b7d7ecc8121 req-f4cf68c0-4def-4c81-9f5a-058ffc1220da service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118998 Aug 09 11:19:28.238630 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 105/212] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:19:28.263873 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-6d56ff3f-be89-4a9d-b238-82802581b01f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:28.265175 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-6d56ff3f-be89-4a9d-b238-82802581b01f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:28.288526 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6d56ff3f-be89-4a9d-b238-82802581b01f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:28.293049 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6d56ff3f-be89-4a9d-b238-82802581b01f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:28.293714 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6d56ff3f-be89-4a9d-b238-82802581b01f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:28.295056 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6d56ff3f-be89-4a9d-b238-82802581b01f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:28.296006 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6d56ff3f-be89-4a9d-b238-82802581b01f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:28.296752 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6d56ff3f-be89-4a9d-b238-82802581b01f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:28.382594 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-734b3bf0-98d4-44d2-a115-346373551ff8 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c011df2b144f758dd286e77875bcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37fc7dacc11483ca9c6f047d3bd2553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:28.399186 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-734b3bf0-98d4-44d2-a115-346373551ff8 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] 10.222.0.27 "GET /compute/v2.1/servers/e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6" status: 200 len: 1460 microversion: 2.1 time: 0.277603 Aug 09 11:19:28.408777 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 108/213] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:28 2022] GET /compute/v2.1/servers/e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6 => generated 1460 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:28.411814 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-6d56ff3f-be89-4a9d-b238-82802581b01f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:28.419966 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-6d56ff3f-be89-4a9d-b238-82802581b01f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697" status: 200 len: 1280 microversion: 2.1 time: 0.179055 Aug 09 11:19:28.420992 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 106/214] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:28 2022] GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697 => generated 1280 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:28.423074 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [req-4fc4b9ea-907e-47f4-8e7f-01cf47a6ca04 req-5e5da2b6-bedf-49a6-a70b-6018898751dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41447c00-5903-4495-9529-ec080a0840c1", "tag": "60ac3d32-12ed-40f1-8fe2-2f77df55feb9"}]} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:19:28.435649 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-4fc4b9ea-907e-47f4-8e7f-01cf47a6ca04 req-5e5da2b6-bedf-49a6-a70b-6018898751dc service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:28.436130 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-4fc4b9ea-907e-47f4-8e7f-01cf47a6ca04 req-5e5da2b6-bedf-49a6-a70b-6018898751dc service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:28.436631 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-4fc4b9ea-907e-47f4-8e7f-01cf47a6ca04 req-5e5da2b6-bedf-49a6-a70b-6018898751dc service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:28.449308 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.compute.server_external_events [req-4fc4b9ea-907e-47f4-8e7f-01cf47a6ca04 req-5e5da2b6-bedf-49a6-a70b-6018898751dc service nova] Creating event network-changed:60ac3d32-12ed-40f1-8fe2-2f77df55feb9 for instance 41447c00-5903-4495-9529-ec080a0840c1 on hv-cinder-85251 Aug 09 11:19:28.456697 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [req-4fc4b9ea-907e-47f4-8e7f-01cf47a6ca04 req-5e5da2b6-bedf-49a6-a70b-6018898751dc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037754 Aug 09 11:19:28.457868 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 109/215] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:19:29.428648 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-c16250a7-617d-4526-95a5-59aea40f7564 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:29.429266 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-c16250a7-617d-4526-95a5-59aea40f7564 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] [instance: e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:29.441748 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-a17c1720-3ce7-4c0d-905b-400ae9988ee9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:29.442483 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-a17c1720-3ce7-4c0d-905b-400ae9988ee9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:29.449485 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c16250a7-617d-4526-95a5-59aea40f7564 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:29.454964 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a17c1720-3ce7-4c0d-905b-400ae9988ee9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:29.455869 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c16250a7-617d-4526-95a5-59aea40f7564 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:29.456410 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c16250a7-617d-4526-95a5-59aea40f7564 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:29.457414 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c16250a7-617d-4526-95a5-59aea40f7564 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:29.458046 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c16250a7-617d-4526-95a5-59aea40f7564 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:29.458692 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c16250a7-617d-4526-95a5-59aea40f7564 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:29.459627 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a17c1720-3ce7-4c0d-905b-400ae9988ee9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:29.461001 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a17c1720-3ce7-4c0d-905b-400ae9988ee9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:29.461743 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a17c1720-3ce7-4c0d-905b-400ae9988ee9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:29.462951 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a17c1720-3ce7-4c0d-905b-400ae9988ee9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:29.465028 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a17c1720-3ce7-4c0d-905b-400ae9988ee9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:29.490275 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.wsgi [None req-c16250a7-617d-4526-95a5-59aea40f7564 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] HTTP exception thrown: Instance e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6 could not be found. Aug 09 11:19:29.492326 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-c16250a7-617d-4526-95a5-59aea40f7564 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Request method failure captured: Aug 09 11:19:29.492326 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: request: GET /compute/v2.1/servers/e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6 HTTP/1.1 Aug 09 11:19:29.492326 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Accept: application/json Aug 09 11:19:29.492326 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Accept-Encoding: identity Aug 09 11:19:29.492326 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Connection: close Aug 09 11:19:29.492326 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Content-Length: 0 Aug 09 11:19:29.492326 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Content-Type: application/json Aug 09 11:19:29.492326 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Host: 10.222.0.27 Aug 09 11:19:29.492326 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Openstack-System-Scope: None Aug 09 11:19:29.492326 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: User-Agent: python-urllib3/1.26.11 Aug 09 11:19:29.492326 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Auth-Token: gAAAAABi8kKPXT5Az0fyiHWu7Crf9-MUHsm0CEjd_NdpmmGr3EZTy56KmGHAc4XLGezMg-xmO6oR4Pj_49j1sFYKcfyabe9M47VDph9P2SSSU6Cz1L9QTLPg2AsySkBlHb_CO4Mi443Hq3RWwBJHmpTNRixHbzp8sjtvf09tgrNjwCWSlBgQjq0 Aug 09 11:19:29.492326 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Domain-Id: None Aug 09 11:19:29.492326 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Domain-Name: None Aug 09 11:19:29.492326 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Identity-Status: Confirmed Aug 09 11:19:29.492326 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Is-Admin-Project: True Aug 09 11:19:29.492326 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Domain-Id: default Aug 09 11:19:29.492326 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Domain-Name: Default Aug 09 11:19:29.492326 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Id: b37fc7dacc11483ca9c6f047d3bd2553 Aug 09 11:19:29.492326 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Name: tempest-VolumesActionsTest-475547032 Aug 09 11:19:29.492326 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Role: member,reader Aug 09 11:19:29.492326 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Roles: member,reader Aug 09 11:19:29.493810 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b37fc7dacc11483ca9c6f047d3bd2553"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b37fc7dacc11483ca9c6f047d3bd2553"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b37fc7dacc11483ca9c6f047d3bd2553"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b37fc7dacc11483ca9c6f047d3bd2553"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:19:29.493810 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant: tempest-VolumesActionsTest-475547032 Aug 09 11:19:29.493810 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant-Id: b37fc7dacc11483ca9c6f047d3bd2553 Aug 09 11:19:29.493810 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant-Name: tempest-VolumesActionsTest-475547032 Aug 09 11:19:29.493810 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User: tempest-VolumesActionsTest-475547032-project Aug 09 11:19:29.493810 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Domain-Id: default Aug 09 11:19:29.493810 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Domain-Name: Default Aug 09 11:19:29.493810 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Id: b3c011df2b144f758dd286e77875bcc8 Aug 09 11:19:29.493810 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Name: tempest-VolumesActionsTest-475547032-project Aug 09 11:19:29.493810 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: method: > Aug 09 11:19:29.493810 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: exception: Instance e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6 could not be found. Aug 09 11:19:29.493810 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: action_args: {'id': 'e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6'} Aug 09 11:19:29.494593 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:19:29.494593 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:19:29.494593 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:19:29.494593 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:19:29.494593 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:19:29.494593 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:19:29.494593 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:19:29.494593 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:19:29.494593 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:19:29.494593 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:19:29.494593 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6 could not be found. Aug 09 11:19:29.494593 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:19:29.494593 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:19:29.494593 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:19:29.494593 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:19:29.494593 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:19:29.494593 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:19:29.494593 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:19:29.494593 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:19:29.494593 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:19:29.495793 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:19:29.495793 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:19:29.495793 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:19:29.495793 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:19:29.495793 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:19:29.495793 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:19:29.495793 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:19:29.495793 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6 could not be found. Aug 09 11:19:29.495793 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:19:29.495793 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:19:29.495793 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:19:29.495793 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:19:29.495793 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:19:29.495793 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:19:29.495793 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:19:29.495793 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:19:29.495793 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6 could not be found. Aug 09 11:19:29.495793 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:19:29.497004 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-c16250a7-617d-4526-95a5-59aea40f7564 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] Returning 404 to user: Instance e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6 could not be found. {{(pid=117685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:19:29.497004 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-c16250a7-617d-4526-95a5-59aea40f7564 tempest-VolumesActionsTest-475547032 tempest-VolumesActionsTest-475547032-project] 10.222.0.27 "GET /compute/v2.1/servers/e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6" status: 404 len: 111 microversion: 2.1 time: 0.070784 Aug 09 11:19:29.503474 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 107/216] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:29 2022] GET /compute/v2.1/servers/e1fc1d5d-1af7-46f2-aedf-7ef0f448ffe6 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:19:29.680527 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-a17c1720-3ce7-4c0d-905b-400ae9988ee9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:29.690620 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-a17c1720-3ce7-4c0d-905b-400ae9988ee9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697" status: 200 len: 1322 microversion: 2.1 time: 0.253339 Aug 09 11:19:29.707997 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 110/217] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:29 2022] GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697 => generated 1322 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:30.472279 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-4a23a99e-1b60-499c-ae82-37ae70f3ba5e req-393d5b23-7b87-4e41-9b98-409234a6a7eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adaae31d-051b-44d0-b6a7-ac5e3aa15697", "tag": "8f3b07d6-b63e-4e36-8e6f-5b71de7a9b5f"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:19:30.488443 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-4a23a99e-1b60-499c-ae82-37ae70f3ba5e req-393d5b23-7b87-4e41-9b98-409234a6a7eb service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:30.488934 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-4a23a99e-1b60-499c-ae82-37ae70f3ba5e req-393d5b23-7b87-4e41-9b98-409234a6a7eb service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:30.489401 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-4a23a99e-1b60-499c-ae82-37ae70f3ba5e req-393d5b23-7b87-4e41-9b98-409234a6a7eb service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:30.501357 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-4a23a99e-1b60-499c-ae82-37ae70f3ba5e req-393d5b23-7b87-4e41-9b98-409234a6a7eb service nova] Creating event network-changed:8f3b07d6-b63e-4e36-8e6f-5b71de7a9b5f for instance adaae31d-051b-44d0-b6a7-ac5e3aa15697 on hv-cinder-85251 Aug 09 11:19:30.506931 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-4a23a99e-1b60-499c-ae82-37ae70f3ba5e req-393d5b23-7b87-4e41-9b98-409234a6a7eb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038392 Aug 09 11:19:30.507847 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 108/218] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:19:30.720212 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-17e91dbb-58f0-499a-8d2a-3e6e9162f461 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:30.724107 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-17e91dbb-58f0-499a-8d2a-3e6e9162f461 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:30.735901 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-17e91dbb-58f0-499a-8d2a-3e6e9162f461 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:30.736777 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-17e91dbb-58f0-499a-8d2a-3e6e9162f461 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:30.739377 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-17e91dbb-58f0-499a-8d2a-3e6e9162f461 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:30.740369 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-17e91dbb-58f0-499a-8d2a-3e6e9162f461 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:30.742616 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-17e91dbb-58f0-499a-8d2a-3e6e9162f461 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:30.743188 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-17e91dbb-58f0-499a-8d2a-3e6e9162f461 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:31.108436 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-17e91dbb-58f0-499a-8d2a-3e6e9162f461 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:31.123297 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-17e91dbb-58f0-499a-8d2a-3e6e9162f461 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697" status: 200 len: 1322 microversion: 2.1 time: 0.407272 Aug 09 11:19:31.125221 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 111/219] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:30 2022] GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697 => generated 1322 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:32.146110 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-5f3063f6-d1f5-48f5-bcaf-ba9e33a98446 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:32.146806 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-5f3063f6-d1f5-48f5-bcaf-ba9e33a98446 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:32.154353 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5f3063f6-d1f5-48f5-bcaf-ba9e33a98446 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:32.154873 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5f3063f6-d1f5-48f5-bcaf-ba9e33a98446 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:32.155279 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5f3063f6-d1f5-48f5-bcaf-ba9e33a98446 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:32.156195 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5f3063f6-d1f5-48f5-bcaf-ba9e33a98446 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:32.157006 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5f3063f6-d1f5-48f5-bcaf-ba9e33a98446 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:32.157431 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5f3063f6-d1f5-48f5-bcaf-ba9e33a98446 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:32.177995 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:32.398974 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-5f3063f6-d1f5-48f5-bcaf-ba9e33a98446 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:32.407570 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-5f3063f6-d1f5-48f5-bcaf-ba9e33a98446 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697" status: 200 len: 1322 microversion: 2.1 time: 0.265676 Aug 09 11:19:32.408489 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 109/220] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:32 2022] GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697 => generated 1322 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:32.988238 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-42b8ccfe-6a2c-434a-8141-481bbca18d1a tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:32.989360 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-42b8ccfe-6a2c-434a-8141-481bbca18d1a tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:32.996717 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-42b8ccfe-6a2c-434a-8141-481bbca18d1a tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:32.997379 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-42b8ccfe-6a2c-434a-8141-481bbca18d1a tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:32.997996 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-42b8ccfe-6a2c-434a-8141-481bbca18d1a tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:32.998887 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-42b8ccfe-6a2c-434a-8141-481bbca18d1a tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:32.999521 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-42b8ccfe-6a2c-434a-8141-481bbca18d1a tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:33.000093 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-42b8ccfe-6a2c-434a-8141-481bbca18d1a tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:33.186158 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-42b8ccfe-6a2c-434a-8141-481bbca18d1a tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f/ips" status: 200 len: 146 microversion: 2.1 time: 0.208311 Aug 09 11:19:33.186733 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 112/221] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Aug 9 11:19:32 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f/ips => generated 146 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:19:33.430691 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-09643402-fb0f-4e9a-96ef-54b06e42894c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:33.431285 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-09643402-fb0f-4e9a-96ef-54b06e42894c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:33.437510 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-09643402-fb0f-4e9a-96ef-54b06e42894c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:33.438209 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-09643402-fb0f-4e9a-96ef-54b06e42894c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:33.438649 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-09643402-fb0f-4e9a-96ef-54b06e42894c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:33.439533 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-09643402-fb0f-4e9a-96ef-54b06e42894c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:33.439978 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-09643402-fb0f-4e9a-96ef-54b06e42894c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:33.440391 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-09643402-fb0f-4e9a-96ef-54b06e42894c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:33.603258 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell0:SELECT=4 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:33.696086 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-09643402-fb0f-4e9a-96ef-54b06e42894c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:33.705711 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-09643402-fb0f-4e9a-96ef-54b06e42894c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697" status: 200 len: 1322 microversion: 2.1 time: 0.279887 Aug 09 11:19:33.706431 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 110/222] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:33 2022] GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697 => generated 1322 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:33.875670 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-3e0cc246-593b-4811-b733-ecb7025caa0c tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-216926320", "imageRef": "2321e9a0-fe0f-47fd-9c4b-8868eb5a00af", "flavorRef": "452", "networks": [{"uuid": "f9d31597-56ec-4fa4-8984-e0f122e23e6f"}]}} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:19:33.884142 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell0:SELECT=4 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:33.884944 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell0:SELECT=14 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:33.965950 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.network.neutron [None req-3e0cc246-593b-4811-b733-ecb7025caa0c tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] validate_networks() for [('f9d31597-56ec-4fa4-8984-e0f122e23e6f', None, None, None, None, None)] {{(pid=117684) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 11:19:34.731947 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-705a99c4-1798-4fb3-9456-e786ab8962d7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:34.734267 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-705a99c4-1798-4fb3-9456-e786ab8962d7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:34.765381 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-705a99c4-1798-4fb3-9456-e786ab8962d7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:34.766778 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-705a99c4-1798-4fb3-9456-e786ab8962d7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:34.767214 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-705a99c4-1798-4fb3-9456-e786ab8962d7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:34.767929 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-705a99c4-1798-4fb3-9456-e786ab8962d7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:34.771865 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-705a99c4-1798-4fb3-9456-e786ab8962d7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:34.774317 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-705a99c4-1798-4fb3-9456-e786ab8962d7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:34.870667 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-3e0cc246-593b-4811-b733-ecb7025caa0c tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Flavor limits 0:0:0 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 11:19:34.871215 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-3e0cc246-593b-4811-b733-ecb7025caa0c tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Image limits 0:0:0 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 11:19:34.871941 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-3e0cc246-593b-4811-b733-ecb7025caa0c tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Flavor pref 0:0:0 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 11:19:34.872566 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-3e0cc246-593b-4811-b733-ecb7025caa0c tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Image pref 0:0:0 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 11:19:34.873442 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-3e0cc246-593b-4811-b733-ecb7025caa0c tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 11:19:34.895602 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3e0cc246-593b-4811-b733-ecb7025caa0c tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:34.897592 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3e0cc246-593b-4811-b733-ecb7025caa0c tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:34.898203 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3e0cc246-593b-4811-b733-ecb7025caa0c tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:34.900188 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3e0cc246-593b-4811-b733-ecb7025caa0c tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:34.900844 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3e0cc246-593b-4811-b733-ecb7025caa0c tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:34.902403 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3e0cc246-593b-4811-b733-ecb7025caa0c tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:34.988014 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.quota [None req-3e0cc246-593b-4811-b733-ecb7025caa0c tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Getting quotas for project 7a2f6acb3c3a4b24be797a677d868227. Resources: {'cores', 'instances', 'ram'} {{(pid=117684) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:19:35.022981 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.quota [None req-3e0cc246-593b-4811-b733-ecb7025caa0c tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Getting quotas for user ff3135cc1482461caf69068b659f49e4 and project 7a2f6acb3c3a4b24be797a677d868227. Resources: {'cores', 'instances', 'ram'} {{(pid=117684) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:19:35.066379 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-3e0cc246-593b-4811-b733-ecb7025caa0c tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Going to run 1 instances... {{(pid=117684) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 11:19:35.068144 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-705a99c4-1798-4fb3-9456-e786ab8962d7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:35.077505 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-3e0cc246-593b-4811-b733-ecb7025caa0c tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] [instance: 14c1cdbe-3b15-499a-88b5-7f86dfc5501b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2321e9a0-fe0f-47fd-9c4b-8868eb5a00af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117684) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 11:19:35.077704 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-705a99c4-1798-4fb3-9456-e786ab8962d7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697" status: 200 len: 1322 microversion: 2.1 time: 0.352845 Aug 09 11:19:35.080374 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 111/223] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:34 2022] GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697 => generated 1322 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:19:35.168720 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-3e0cc246-593b-4811-b733-ecb7025caa0c tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.298257 Aug 09 11:19:35.176077 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 113/224] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 9 11:19:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1306 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 11:19:35.181273 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-2aeae671-2e47-4463-aa5b-354d9f7c9aa7 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:35.182315 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-2aeae671-2e47-4463-aa5b-354d9f7c9aa7 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] [instance: 14c1cdbe-3b15-499a-88b5-7f86dfc5501b] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:35.348741 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-2aeae671-2e47-4463-aa5b-354d9f7c9aa7 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff3135cc1482461caf69068b659f49e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2f6acb3c3a4b24be797a677d868227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:35.359734 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-2aeae671-2e47-4463-aa5b-354d9f7c9aa7 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] 10.222.0.27 "GET /compute/v2.1/servers/14c1cdbe-3b15-499a-88b5-7f86dfc5501b" status: 200 len: 1218 microversion: 2.1 time: 0.182691 Aug 09 11:19:35.361822 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 112/225] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:35 2022] GET /compute/v2.1/servers/14c1cdbe-3b15-499a-88b5-7f86dfc5501b => generated 1218 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:36.110659 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-1a21fe9f-ee43-4334-a595-6742a3df3c60 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:36.111966 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-1a21fe9f-ee43-4334-a595-6742a3df3c60 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:36.132305 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-78ce1036-25f4-4d3c-99e8-34d93fc232fd tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c6288cef-a74d-4fd7-a93a-8631e2154217"}} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:19:36.139727 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-78ce1036-25f4-4d3c-99e8-34d93fc232fd tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:36.182905 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-78ce1036-25f4-4d3c-99e8-34d93fc232fd tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:36.185435 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1a21fe9f-ee43-4334-a595-6742a3df3c60 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:36.186832 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-78ce1036-25f4-4d3c-99e8-34d93fc232fd tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:36.189234 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-78ce1036-25f4-4d3c-99e8-34d93fc232fd tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:36.189378 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1a21fe9f-ee43-4334-a595-6742a3df3c60 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:36.190582 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-78ce1036-25f4-4d3c-99e8-34d93fc232fd tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:36.191557 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1a21fe9f-ee43-4334-a595-6742a3df3c60 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:36.192578 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1a21fe9f-ee43-4334-a595-6742a3df3c60 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:36.194612 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-78ce1036-25f4-4d3c-99e8-34d93fc232fd tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:36.194932 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1a21fe9f-ee43-4334-a595-6742a3df3c60 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:36.195053 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-78ce1036-25f4-4d3c-99e8-34d93fc232fd tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:36.195610 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1a21fe9f-ee43-4334-a595-6742a3df3c60 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:36.265779 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:36.546726 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-1a21fe9f-ee43-4334-a595-6742a3df3c60 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:36.554874 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-1a21fe9f-ee43-4334-a595-6742a3df3c60 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697" status: 200 len: 1322 microversion: 2.1 time: 0.457182 Aug 09 11:19:36.558859 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 114/226] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:36 2022] GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697 => generated 1322 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:36.568913 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-f1d4afd6-7414-437b-99d2-b80346c49bda tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:36.570175 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-f1d4afd6-7414-437b-99d2-b80346c49bda tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] [instance: 14c1cdbe-3b15-499a-88b5-7f86dfc5501b] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:36.586932 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f1d4afd6-7414-437b-99d2-b80346c49bda tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:36.588780 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f1d4afd6-7414-437b-99d2-b80346c49bda tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:36.591448 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f1d4afd6-7414-437b-99d2-b80346c49bda tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:36.592211 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f1d4afd6-7414-437b-99d2-b80346c49bda tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:36.592810 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f1d4afd6-7414-437b-99d2-b80346c49bda tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:36.593249 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f1d4afd6-7414-437b-99d2-b80346c49bda tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:36.757502 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-f1d4afd6-7414-437b-99d2-b80346c49bda tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff3135cc1482461caf69068b659f49e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2f6acb3c3a4b24be797a677d868227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:36.767719 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-f1d4afd6-7414-437b-99d2-b80346c49bda tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] 10.222.0.27 "GET /compute/v2.1/servers/14c1cdbe-3b15-499a-88b5-7f86dfc5501b" status: 200 len: 1214 microversion: 2.1 time: 0.207481 Aug 09 11:19:36.785128 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 115/227] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:36 2022] GET /compute/v2.1/servers/14c1cdbe-3b15-499a-88b5-7f86dfc5501b => generated 1214 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:37.067002 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-78ce1036-25f4-4d3c-99e8-34d93fc232fd tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "POST /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.935806 Aug 09 11:19:37.084303 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 113/228] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Aug 9 11:19:36 2022] POST /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f/os-volume_attachments => generated 194 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:19:37.582653 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-b3984ea0-d256-4e6d-82c8-0c448c77b56e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:37.584936 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-b3984ea0-d256-4e6d-82c8-0c448c77b56e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:37.595648 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b3984ea0-d256-4e6d-82c8-0c448c77b56e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:37.604210 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b3984ea0-d256-4e6d-82c8-0c448c77b56e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:37.604702 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b3984ea0-d256-4e6d-82c8-0c448c77b56e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:37.605463 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b3984ea0-d256-4e6d-82c8-0c448c77b56e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:37.605922 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b3984ea0-d256-4e6d-82c8-0c448c77b56e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:37.606350 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b3984ea0-d256-4e6d-82c8-0c448c77b56e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:37.791479 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-7fe46afd-3d11-4d69-b6ac-bb1374e5c597 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:37.793281 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-7fe46afd-3d11-4d69-b6ac-bb1374e5c597 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] [instance: 14c1cdbe-3b15-499a-88b5-7f86dfc5501b] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:37.808508 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7fe46afd-3d11-4d69-b6ac-bb1374e5c597 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:37.811400 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7fe46afd-3d11-4d69-b6ac-bb1374e5c597 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:37.817519 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7fe46afd-3d11-4d69-b6ac-bb1374e5c597 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:37.818687 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7fe46afd-3d11-4d69-b6ac-bb1374e5c597 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:37.819398 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7fe46afd-3d11-4d69-b6ac-bb1374e5c597 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:37.820079 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7fe46afd-3d11-4d69-b6ac-bb1374e5c597 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:37.945362 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-b3984ea0-d256-4e6d-82c8-0c448c77b56e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:37.966486 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-b3984ea0-d256-4e6d-82c8-0c448c77b56e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697" status: 200 len: 1322 microversion: 2.1 time: 0.393881 Aug 09 11:19:37.966797 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-7fe46afd-3d11-4d69-b6ac-bb1374e5c597 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff3135cc1482461caf69068b659f49e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2f6acb3c3a4b24be797a677d868227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:37.979811 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 116/229] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:37 2022] GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697 => generated 1322 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:37.982794 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-7fe46afd-3d11-4d69-b6ac-bb1374e5c597 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] 10.222.0.27 "GET /compute/v2.1/servers/14c1cdbe-3b15-499a-88b5-7f86dfc5501b" status: 200 len: 1276 microversion: 2.1 time: 0.196830 Aug 09 11:19:37.987480 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 114/230] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:37 2022] GET /compute/v2.1/servers/14c1cdbe-3b15-499a-88b5-7f86dfc5501b => generated 1276 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:19:38.046007 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-47302a8f-2d49-4998-92b0-ffd83b51c364 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:38.047793 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-47302a8f-2d49-4998-92b0-ffd83b51c364 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:38.060862 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-47302a8f-2d49-4998-92b0-ffd83b51c364 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:38.063298 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-47302a8f-2d49-4998-92b0-ffd83b51c364 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:38.064714 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-47302a8f-2d49-4998-92b0-ffd83b51c364 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:38.067405 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-47302a8f-2d49-4998-92b0-ffd83b51c364 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:38.068930 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-47302a8f-2d49-4998-92b0-ffd83b51c364 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:38.069544 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-47302a8f-2d49-4998-92b0-ffd83b51c364 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:38.155216 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-47302a8f-2d49-4998-92b0-ffd83b51c364 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f/ips" status: 200 len: 151 microversion: 2.20 time: 0.115752 Aug 09 11:19:38.156655 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 117/231] 10.222.0.27 () {60 vars in 1289 bytes} [Tue Aug 9 11:19:38 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f/ips => generated 151 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 11:19:38.992980 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-2fad4769-d281-40f4-a41f-8f352aff5a59 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:38.993788 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-2fad4769-d281-40f4-a41f-8f352aff5a59 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:39.006318 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2fad4769-d281-40f4-a41f-8f352aff5a59 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:39.013080 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-a3f93478-981e-4cf5-a7d3-37ac57808018 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:39.014455 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-a3f93478-981e-4cf5-a7d3-37ac57808018 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] [instance: 14c1cdbe-3b15-499a-88b5-7f86dfc5501b] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:39.019180 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2fad4769-d281-40f4-a41f-8f352aff5a59 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:39.024972 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a3f93478-981e-4cf5-a7d3-37ac57808018 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:39.026645 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2fad4769-d281-40f4-a41f-8f352aff5a59 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:39.028854 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2fad4769-d281-40f4-a41f-8f352aff5a59 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:39.032521 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2fad4769-d281-40f4-a41f-8f352aff5a59 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:39.033865 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2fad4769-d281-40f4-a41f-8f352aff5a59 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:39.046270 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a3f93478-981e-4cf5-a7d3-37ac57808018 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:39.047278 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a3f93478-981e-4cf5-a7d3-37ac57808018 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:39.053900 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a3f93478-981e-4cf5-a7d3-37ac57808018 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:39.061867 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a3f93478-981e-4cf5-a7d3-37ac57808018 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:39.063310 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a3f93478-981e-4cf5-a7d3-37ac57808018 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:39.258292 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-a3f93478-981e-4cf5-a7d3-37ac57808018 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff3135cc1482461caf69068b659f49e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2f6acb3c3a4b24be797a677d868227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:39.326032 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-a3f93478-981e-4cf5-a7d3-37ac57808018 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] 10.222.0.27 "GET /compute/v2.1/servers/14c1cdbe-3b15-499a-88b5-7f86dfc5501b" status: 200 len: 1276 microversion: 2.1 time: 0.317538 Aug 09 11:19:39.337425 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 118/232] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:39 2022] GET /compute/v2.1/servers/14c1cdbe-3b15-499a-88b5-7f86dfc5501b => generated 1276 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:39.480945 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-2fad4769-d281-40f4-a41f-8f352aff5a59 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:39.496933 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-2fad4769-d281-40f4-a41f-8f352aff5a59 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697" status: 200 len: 1322 microversion: 2.1 time: 0.508359 Aug 09 11:19:39.510712 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 115/233] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:38 2022] GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697 => generated 1322 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:39.669915 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [req-0d75c456-bd82-456f-86ff-9e5c14daacc8 req-9a6de1f4-bb49-49b2-a328-63c989cb5ff6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41447c00-5903-4495-9529-ec080a0840c1", "name": "network-vif-plugged", "status": "completed", "tag": "60ac3d32-12ed-40f1-8fe2-2f77df55feb9"}]} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:19:39.683145 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-0d75c456-bd82-456f-86ff-9e5c14daacc8 req-9a6de1f4-bb49-49b2-a328-63c989cb5ff6 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:39.683894 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-0d75c456-bd82-456f-86ff-9e5c14daacc8 req-9a6de1f4-bb49-49b2-a328-63c989cb5ff6 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:39.685979 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-0d75c456-bd82-456f-86ff-9e5c14daacc8 req-9a6de1f4-bb49-49b2-a328-63c989cb5ff6 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:39.732175 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.compute.server_external_events [req-0d75c456-bd82-456f-86ff-9e5c14daacc8 req-9a6de1f4-bb49-49b2-a328-63c989cb5ff6 service nova] Creating event network-vif-plugged:60ac3d32-12ed-40f1-8fe2-2f77df55feb9 for instance 41447c00-5903-4495-9529-ec080a0840c1 on hv-cinder-85251 Aug 09 11:19:39.748164 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [req-0d75c456-bd82-456f-86ff-9e5c14daacc8 req-9a6de1f4-bb49-49b2-a328-63c989cb5ff6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083426 Aug 09 11:19:39.748910 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 119/234] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:19:40.354168 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-8b2b10c1-86cb-44a9-b98c-db326faa4f09 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:40.354801 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-8b2b10c1-86cb-44a9-b98c-db326faa4f09 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 1329e8e9-9358-454d-bea3-dad19dfc53da] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:40.360114 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-ec6f53dc-e3a9-45e3-9577-b6aab58e0821 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:40.361865 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-ec6f53dc-e3a9-45e3-9577-b6aab58e0821 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] [instance: 14c1cdbe-3b15-499a-88b5-7f86dfc5501b] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:40.365999 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8b2b10c1-86cb-44a9-b98c-db326faa4f09 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:40.366494 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8b2b10c1-86cb-44a9-b98c-db326faa4f09 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:40.366966 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8b2b10c1-86cb-44a9-b98c-db326faa4f09 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:40.374724 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8b2b10c1-86cb-44a9-b98c-db326faa4f09 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:40.379671 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8b2b10c1-86cb-44a9-b98c-db326faa4f09 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:40.381229 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8b2b10c1-86cb-44a9-b98c-db326faa4f09 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:40.383374 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ec6f53dc-e3a9-45e3-9577-b6aab58e0821 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:40.383872 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ec6f53dc-e3a9-45e3-9577-b6aab58e0821 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:40.384385 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ec6f53dc-e3a9-45e3-9577-b6aab58e0821 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:40.385071 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ec6f53dc-e3a9-45e3-9577-b6aab58e0821 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:40.385524 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ec6f53dc-e3a9-45e3-9577-b6aab58e0821 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:40.385963 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ec6f53dc-e3a9-45e3-9577-b6aab58e0821 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:40.500299 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-8b2b10c1-86cb-44a9-b98c-db326faa4f09 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da/ips" status: 200 len: 150 microversion: 2.1 time: 0.149788 Aug 09 11:19:40.516935 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 116/235] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Aug 9 11:19:40 2022] GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da/ips => generated 150 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:19:40.542246 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-da1d84f5-e122-4bd4-a8bd-76e6ef0cb42b tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:40.542891 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-da1d84f5-e122-4bd4-a8bd-76e6ef0cb42b tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:40.572493 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-da1d84f5-e122-4bd4-a8bd-76e6ef0cb42b tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:40.581856 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-da1d84f5-e122-4bd4-a8bd-76e6ef0cb42b tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:40.582676 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-da1d84f5-e122-4bd4-a8bd-76e6ef0cb42b tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:40.586315 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-da1d84f5-e122-4bd4-a8bd-76e6ef0cb42b tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:40.589611 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-da1d84f5-e122-4bd4-a8bd-76e6ef0cb42b tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:40.592709 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-da1d84f5-e122-4bd4-a8bd-76e6ef0cb42b tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:40.731457 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-ec6f53dc-e3a9-45e3-9577-b6aab58e0821 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff3135cc1482461caf69068b659f49e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2f6acb3c3a4b24be797a677d868227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:40.740089 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-ec6f53dc-e3a9-45e3-9577-b6aab58e0821 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] 10.222.0.27 "GET /compute/v2.1/servers/14c1cdbe-3b15-499a-88b5-7f86dfc5501b" status: 200 len: 1318 microversion: 2.1 time: 0.384521 Aug 09 11:19:40.744615 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 120/236] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:40 2022] GET /compute/v2.1/servers/14c1cdbe-3b15-499a-88b5-7f86dfc5501b => generated 1318 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:19:40.758374 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-52658679-e7c0-46e7-8551-772c08a72183 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:19:40.759270 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-52658679-e7c0-46e7-8551-772c08a72183 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:40.783550 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-52658679-e7c0-46e7-8551-772c08a72183 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:40.784054 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-52658679-e7c0-46e7-8551-772c08a72183 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:40.784531 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-52658679-e7c0-46e7-8551-772c08a72183 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:40.785251 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-52658679-e7c0-46e7-8551-772c08a72183 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:40.785700 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-52658679-e7c0-46e7-8551-772c08a72183 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:40.797104 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-52658679-e7c0-46e7-8551-772c08a72183 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:40.846787 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.objects.instance [None req-52658679-e7c0-46e7-8551-772c08a72183 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lazy-loading 'flavor' on Instance uuid 69542c8c-90b6-49a4-aed3-c229168f215f {{(pid=117684) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:19:41.076513 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-da1d84f5-e122-4bd4-a8bd-76e6ef0cb42b tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:41.085764 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-da1d84f5-e122-4bd4-a8bd-76e6ef0cb42b tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697" status: 200 len: 1322 microversion: 2.1 time: 0.564739 Aug 09 11:19:41.087187 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 117/237] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:40 2022] GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697 => generated 1322 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:41.478680 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-52658679-e7c0-46e7-8551-772c08a72183 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "POST /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f/action" status: 202 len: 0 microversion: 2.20 time: 0.732373 Aug 09 11:19:41.485236 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 121/238] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Aug 9 11:19:40 2022] POST /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f/action => generated 0 bytes in 739 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 11:19:41.507721 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-032b40fe-6531-4e43-a451-b822e7e43be7 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:41.512134 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-032b40fe-6531-4e43-a451-b822e7e43be7 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:41.519256 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-032b40fe-6531-4e43-a451-b822e7e43be7 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:41.520031 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-032b40fe-6531-4e43-a451-b822e7e43be7 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:41.520702 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-032b40fe-6531-4e43-a451-b822e7e43be7 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:41.522733 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-032b40fe-6531-4e43-a451-b822e7e43be7 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:41.523408 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-032b40fe-6531-4e43-a451-b822e7e43be7 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:41.524421 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-032b40fe-6531-4e43-a451-b822e7e43be7 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:41.767409 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-c77aa549-2d86-43a4-9707-7a7eceee010d tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:41.768370 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-032b40fe-6531-4e43-a451-b822e7e43be7 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:41.769184 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-c77aa549-2d86-43a4-9707-7a7eceee010d tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] [instance: 14c1cdbe-3b15-499a-88b5-7f86dfc5501b] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:41.779017 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-032b40fe-6531-4e43-a451-b822e7e43be7 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:41.780960 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-032b40fe-6531-4e43-a451-b822e7e43be7 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:41.782621 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c77aa549-2d86-43a4-9707-7a7eceee010d tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:41.784077 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c77aa549-2d86-43a4-9707-7a7eceee010d tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:41.785881 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-032b40fe-6531-4e43-a451-b822e7e43be7 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1722 microversion: 2.20 time: 0.300356 Aug 09 11:19:41.795980 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c77aa549-2d86-43a4-9707-7a7eceee010d tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:41.796975 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c77aa549-2d86-43a4-9707-7a7eceee010d tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:41.797461 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c77aa549-2d86-43a4-9707-7a7eceee010d tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:41.797952 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c77aa549-2d86-43a4-9707-7a7eceee010d tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:41.810891 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 118/239] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:19:41 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1722 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:19:41.831065 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-b4005c72-945e-4364-b8de-825f3c4c3f22 req-d95a1678-2487-4047-932a-605a74466774 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adaae31d-051b-44d0-b6a7-ac5e3aa15697", "name": "network-vif-plugged", "status": "completed", "tag": "8f3b07d6-b63e-4e36-8e6f-5b71de7a9b5f"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:19:41.850309 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-b4005c72-945e-4364-b8de-825f3c4c3f22 req-d95a1678-2487-4047-932a-605a74466774 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:41.850786 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-b4005c72-945e-4364-b8de-825f3c4c3f22 req-d95a1678-2487-4047-932a-605a74466774 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:41.851216 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-b4005c72-945e-4364-b8de-825f3c4c3f22 req-d95a1678-2487-4047-932a-605a74466774 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:41.900589 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-b4005c72-945e-4364-b8de-825f3c4c3f22 req-d95a1678-2487-4047-932a-605a74466774 service nova] Creating event network-vif-plugged:8f3b07d6-b63e-4e36-8e6f-5b71de7a9b5f for instance adaae31d-051b-44d0-b6a7-ac5e3aa15697 on hv-cinder-85251 Aug 09 11:19:41.917743 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-b4005c72-945e-4364-b8de-825f3c4c3f22 req-d95a1678-2487-4047-932a-605a74466774 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090219 Aug 09 11:19:41.922377 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 119/240] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:19:42.095690 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-c77aa549-2d86-43a4-9707-7a7eceee010d tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff3135cc1482461caf69068b659f49e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2f6acb3c3a4b24be797a677d868227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:42.106022 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-c77aa549-2d86-43a4-9707-7a7eceee010d tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] 10.222.0.27 "GET /compute/v2.1/servers/14c1cdbe-3b15-499a-88b5-7f86dfc5501b" status: 200 len: 1318 microversion: 2.1 time: 0.342503 Aug 09 11:19:42.107092 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 122/241] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:41 2022] GET /compute/v2.1/servers/14c1cdbe-3b15-499a-88b5-7f86dfc5501b => generated 1318 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:19:42.131161 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-8589ea18-507a-40d1-8e4f-ebe70d4452ce tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:42.131938 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-8589ea18-507a-40d1-8e4f-ebe70d4452ce tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:42.161066 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8589ea18-507a-40d1-8e4f-ebe70d4452ce tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:42.172222 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8589ea18-507a-40d1-8e4f-ebe70d4452ce tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:42.172787 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8589ea18-507a-40d1-8e4f-ebe70d4452ce tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:42.173551 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8589ea18-507a-40d1-8e4f-ebe70d4452ce tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:42.174021 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8589ea18-507a-40d1-8e4f-ebe70d4452ce tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:42.174446 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8589ea18-507a-40d1-8e4f-ebe70d4452ce tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:42.439053 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-8589ea18-507a-40d1-8e4f-ebe70d4452ce tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:42.442092 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-734e8b8d-da43-4486-a7f6-077b623b4c90 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "397e1f98-323e-4201-be0c-de0567926b8a"}} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:19:42.445719 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-734e8b8d-da43-4486-a7f6-077b623b4c90 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 1329e8e9-9358-454d-bea3-dad19dfc53da] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:42.451043 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-8589ea18-507a-40d1-8e4f-ebe70d4452ce tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697" status: 200 len: 1322 microversion: 2.1 time: 0.346617 Aug 09 11:19:42.461278 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 120/242] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:42 2022] GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697 => generated 1322 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:42.473733 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-734e8b8d-da43-4486-a7f6-077b623b4c90 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:42.475900 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-734e8b8d-da43-4486-a7f6-077b623b4c90 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:42.476762 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-734e8b8d-da43-4486-a7f6-077b623b4c90 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:42.478828 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-734e8b8d-da43-4486-a7f6-077b623b4c90 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:42.480299 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-734e8b8d-da43-4486-a7f6-077b623b4c90 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:42.483944 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-734e8b8d-da43-4486-a7f6-077b623b4c90 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:42.818335 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-4b95576d-e764-4eed-b6ac-d2fac527d7ce tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:42.819263 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-4b95576d-e764-4eed-b6ac-d2fac527d7ce tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:42.831325 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:42.833036 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4b95576d-e764-4eed-b6ac-d2fac527d7ce tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:42.836131 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4b95576d-e764-4eed-b6ac-d2fac527d7ce tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:42.847459 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4b95576d-e764-4eed-b6ac-d2fac527d7ce tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:42.850566 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4b95576d-e764-4eed-b6ac-d2fac527d7ce tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:42.851813 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4b95576d-e764-4eed-b6ac-d2fac527d7ce tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:42.853664 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4b95576d-e764-4eed-b6ac-d2fac527d7ce tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:43.575683 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-4b95576d-e764-4eed-b6ac-d2fac527d7ce tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:43.589909 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-4b95576d-e764-4eed-b6ac-d2fac527d7ce tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:43.598413 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-4b95576d-e764-4eed-b6ac-d2fac527d7ce tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:43.599702 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-4b95576d-e764-4eed-b6ac-d2fac527d7ce tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1722 microversion: 2.20 time: 0.785400 Aug 09 11:19:43.607913 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 121/243] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:19:42 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1722 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:19:43.634784 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-ae162d74-45fe-47bf-ac93-a1fa211750f0 req-c0d21f5f-400f-475f-9598-71eeb40f18dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14c1cdbe-3b15-499a-88b5-7f86dfc5501b", "tag": "c1c36676-90bc-4859-a8f2-d09c6b02519b"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:19:43.657775 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-ae162d74-45fe-47bf-ac93-a1fa211750f0 req-c0d21f5f-400f-475f-9598-71eeb40f18dd service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:43.658277 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-ae162d74-45fe-47bf-ac93-a1fa211750f0 req-c0d21f5f-400f-475f-9598-71eeb40f18dd service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:43.658704 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-ae162d74-45fe-47bf-ac93-a1fa211750f0 req-c0d21f5f-400f-475f-9598-71eeb40f18dd service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:43.684306 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-ae162d74-45fe-47bf-ac93-a1fa211750f0 req-c0d21f5f-400f-475f-9598-71eeb40f18dd service nova] Creating event network-changed:c1c36676-90bc-4859-a8f2-d09c6b02519b for instance 14c1cdbe-3b15-499a-88b5-7f86dfc5501b on hv-cinder-85251 Aug 09 11:19:43.696433 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-ae162d74-45fe-47bf-ac93-a1fa211750f0 req-c0d21f5f-400f-475f-9598-71eeb40f18dd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087053 Aug 09 11:19:43.697337 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 122/244] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:19:43.706328 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-5415f43c-49e8-4cb2-b484-d7b2ce2a1d98 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:43.715888 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-5415f43c-49e8-4cb2-b484-d7b2ce2a1d98 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] [instance: 14c1cdbe-3b15-499a-88b5-7f86dfc5501b] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:43.722728 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5415f43c-49e8-4cb2-b484-d7b2ce2a1d98 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:43.725640 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5415f43c-49e8-4cb2-b484-d7b2ce2a1d98 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:43.727926 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5415f43c-49e8-4cb2-b484-d7b2ce2a1d98 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:43.727926 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5415f43c-49e8-4cb2-b484-d7b2ce2a1d98 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:43.727926 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5415f43c-49e8-4cb2-b484-d7b2ce2a1d98 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:43.727926 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5415f43c-49e8-4cb2-b484-d7b2ce2a1d98 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:43.836149 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-734e8b8d-da43-4486-a7f6-077b623b4c90 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "POST /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.398623 Aug 09 11:19:43.837483 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 123/245] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Aug 9 11:19:42 2022] POST /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da/os-volume_attachments => generated 194 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:19:43.843711 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-b70d9d5a-0169-442a-8f3c-7459a2ecb66d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:43.848560 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-b70d9d5a-0169-442a-8f3c-7459a2ecb66d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:43.861249 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b70d9d5a-0169-442a-8f3c-7459a2ecb66d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:43.863138 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b70d9d5a-0169-442a-8f3c-7459a2ecb66d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:43.864353 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b70d9d5a-0169-442a-8f3c-7459a2ecb66d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:43.865687 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b70d9d5a-0169-442a-8f3c-7459a2ecb66d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:43.866816 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b70d9d5a-0169-442a-8f3c-7459a2ecb66d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:43.867897 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b70d9d5a-0169-442a-8f3c-7459a2ecb66d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:44.039793 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-5415f43c-49e8-4cb2-b484-d7b2ce2a1d98 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff3135cc1482461caf69068b659f49e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2f6acb3c3a4b24be797a677d868227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:44.049147 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-5415f43c-49e8-4cb2-b484-d7b2ce2a1d98 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] 10.222.0.27 "GET /compute/v2.1/servers/14c1cdbe-3b15-499a-88b5-7f86dfc5501b" status: 200 len: 1318 microversion: 2.1 time: 0.350437 Aug 09 11:19:44.055209 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 123/246] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:43 2022] GET /compute/v2.1/servers/14c1cdbe-3b15-499a-88b5-7f86dfc5501b => generated 1318 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:44.221914 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-b70d9d5a-0169-442a-8f3c-7459a2ecb66d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:44.240480 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-b70d9d5a-0169-442a-8f3c-7459a2ecb66d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697" status: 200 len: 1322 microversion: 2.1 time: 0.396480 Aug 09 11:19:44.243643 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 124/247] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:43 2022] GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697 => generated 1322 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:44.624764 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-59716134-95a6-4b3b-b858-c03d256a82b6 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:44.626292 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-59716134-95a6-4b3b-b858-c03d256a82b6 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:44.644510 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-59716134-95a6-4b3b-b858-c03d256a82b6 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:44.648896 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-59716134-95a6-4b3b-b858-c03d256a82b6 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:44.651268 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-59716134-95a6-4b3b-b858-c03d256a82b6 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:44.653830 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-59716134-95a6-4b3b-b858-c03d256a82b6 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:44.657338 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-59716134-95a6-4b3b-b858-c03d256a82b6 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:44.658006 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-59716134-95a6-4b3b-b858-c03d256a82b6 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:45.081454 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-ee442073-45a0-4c35-8ec3-9f9ec0d3f1d8 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:45.082193 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-ee442073-45a0-4c35-8ec3-9f9ec0d3f1d8 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] [instance: 14c1cdbe-3b15-499a-88b5-7f86dfc5501b] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:45.085249 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell0:SELECT=2 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:45.088232 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell0:SELECT=6 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:45.119271 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ee442073-45a0-4c35-8ec3-9f9ec0d3f1d8 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:45.119880 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ee442073-45a0-4c35-8ec3-9f9ec0d3f1d8 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:45.123639 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ee442073-45a0-4c35-8ec3-9f9ec0d3f1d8 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:45.128140 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ee442073-45a0-4c35-8ec3-9f9ec0d3f1d8 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:45.132715 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ee442073-45a0-4c35-8ec3-9f9ec0d3f1d8 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:45.135427 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ee442073-45a0-4c35-8ec3-9f9ec0d3f1d8 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:45.159922 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-59716134-95a6-4b3b-b858-c03d256a82b6 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:45.196243 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-59716134-95a6-4b3b-b858-c03d256a82b6 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:45.198235 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-59716134-95a6-4b3b-b858-c03d256a82b6 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:45.212056 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-59716134-95a6-4b3b-b858-c03d256a82b6 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1722 microversion: 2.20 time: 0.591668 Aug 09 11:19:45.213027 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 124/248] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:19:44 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1722 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:19:45.264632 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-930abd13-ad99-4127-b54c-d443ea20f2f9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:45.266770 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-930abd13-ad99-4127-b54c-d443ea20f2f9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:45.298652 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-930abd13-ad99-4127-b54c-d443ea20f2f9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:45.299141 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-930abd13-ad99-4127-b54c-d443ea20f2f9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:45.299575 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-930abd13-ad99-4127-b54c-d443ea20f2f9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:45.300303 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-930abd13-ad99-4127-b54c-d443ea20f2f9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:45.300751 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-930abd13-ad99-4127-b54c-d443ea20f2f9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:45.301283 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-930abd13-ad99-4127-b54c-d443ea20f2f9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:45.371412 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell0:SELECT=2 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:45.763016 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-ee442073-45a0-4c35-8ec3-9f9ec0d3f1d8 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff3135cc1482461caf69068b659f49e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2f6acb3c3a4b24be797a677d868227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:45.772412 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-930abd13-ad99-4127-b54c-d443ea20f2f9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:45.797873 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-930abd13-ad99-4127-b54c-d443ea20f2f9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697" status: 200 len: 1515 microversion: 2.1 time: 0.536726 Aug 09 11:19:45.799448 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 125/249] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:45 2022] GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697 => generated 1515 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:45.806864 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-ee442073-45a0-4c35-8ec3-9f9ec0d3f1d8 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] 10.222.0.27 "GET /compute/v2.1/servers/14c1cdbe-3b15-499a-88b5-7f86dfc5501b" status: 200 len: 1318 microversion: 2.1 time: 0.734503 Aug 09 11:19:45.810856 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 125/250] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:45 2022] GET /compute/v2.1/servers/14c1cdbe-3b15-499a-88b5-7f86dfc5501b => generated 1318 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:45.813877 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-4f8292c8-f1ef-4c43-900e-7dc3b4b88d0c tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:19:45.831621 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-352e9ed4-691e-403c-b47c-0dc1e6572eb7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:19:45.837780 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-352e9ed4-691e-403c-b47c-0dc1e6572eb7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:45.843582 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4f8292c8-f1ef-4c43-900e-7dc3b4b88d0c tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:45.850143 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4f8292c8-f1ef-4c43-900e-7dc3b4b88d0c tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:45.850841 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4f8292c8-f1ef-4c43-900e-7dc3b4b88d0c tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:45.853118 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-352e9ed4-691e-403c-b47c-0dc1e6572eb7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:45.853822 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-352e9ed4-691e-403c-b47c-0dc1e6572eb7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:45.854490 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-352e9ed4-691e-403c-b47c-0dc1e6572eb7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:45.860633 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-352e9ed4-691e-403c-b47c-0dc1e6572eb7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:45.861310 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-352e9ed4-691e-403c-b47c-0dc1e6572eb7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:45.861905 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-352e9ed4-691e-403c-b47c-0dc1e6572eb7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:45.908139 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.objects.instance [None req-352e9ed4-691e-403c-b47c-0dc1e6572eb7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lazy-loading 'flavor' on Instance uuid adaae31d-051b-44d0-b6a7-ac5e3aa15697 {{(pid=117684) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:19:45.977871 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-4f8292c8-f1ef-4c43-900e-7dc3b4b88d0c tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Going to try to stop instance {{(pid=117685) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 09 11:19:46.057067 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:46.072792 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:46.093471 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-352e9ed4-691e-403c-b47c-0dc1e6572eb7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "POST /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697/action" status: 200 len: 32 microversion: 2.1 time: 0.277791 Aug 09 11:19:46.100013 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 126/251] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 9 11:19:45 2022] POST /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697/action => generated 32 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 11:19:46.121780 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-4f8292c8-f1ef-4c43-900e-7dc3b4b88d0c tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "POST /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f/action" status: 202 len: 0 microversion: 2.1 time: 0.312439 Aug 09 11:19:46.125357 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 126/252] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 9 11:19:45 2022] POST /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:19:46.147556 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-fbb9c54b-ac4e-4321-b4d3-4fb15056b676 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:46.151300 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-fbb9c54b-ac4e-4321-b4d3-4fb15056b676 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:46.157424 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-003400d1-c566-4b36-a3e8-b7f4bad91446 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:46.164002 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-003400d1-c566-4b36-a3e8-b7f4bad91446 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:46.171742 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-fbb9c54b-ac4e-4321-b4d3-4fb15056b676 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:46.172414 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-fbb9c54b-ac4e-4321-b4d3-4fb15056b676 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:46.173106 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-fbb9c54b-ac4e-4321-b4d3-4fb15056b676 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:46.174618 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-fbb9c54b-ac4e-4321-b4d3-4fb15056b676 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:46.175390 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-fbb9c54b-ac4e-4321-b4d3-4fb15056b676 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:46.176769 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-fbb9c54b-ac4e-4321-b4d3-4fb15056b676 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:46.205609 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-003400d1-c566-4b36-a3e8-b7f4bad91446 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:46.206259 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-003400d1-c566-4b36-a3e8-b7f4bad91446 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:46.207060 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-003400d1-c566-4b36-a3e8-b7f4bad91446 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:46.207777 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-003400d1-c566-4b36-a3e8-b7f4bad91446 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:46.208224 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-003400d1-c566-4b36-a3e8-b7f4bad91446 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:46.209111 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-003400d1-c566-4b36-a3e8-b7f4bad91446 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:46.647800 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-003400d1-c566-4b36-a3e8-b7f4bad91446 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:46.656918 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-003400d1-c566-4b36-a3e8-b7f4bad91446 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1723 microversion: 2.1 time: 0.529916 Aug 09 11:19:46.675306 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 127/253] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:46 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1723 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:46.680827 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-fbb9c54b-ac4e-4321-b4d3-4fb15056b676 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:46.681776 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-fefb4220-75ef-4f9a-89d2-4f900d522280 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:46.682640 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-fefb4220-75ef-4f9a-89d2-4f900d522280 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:46.689804 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fefb4220-75ef-4f9a-89d2-4f900d522280 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:46.690536 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fefb4220-75ef-4f9a-89d2-4f900d522280 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:46.691220 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fefb4220-75ef-4f9a-89d2-4f900d522280 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:46.692131 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fefb4220-75ef-4f9a-89d2-4f900d522280 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:46.692935 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fefb4220-75ef-4f9a-89d2-4f900d522280 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:46.694349 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fefb4220-75ef-4f9a-89d2-4f900d522280 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:46.705126 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-fbb9c54b-ac4e-4321-b4d3-4fb15056b676 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697" status: 200 len: 1521 microversion: 2.1 time: 0.603035 Aug 09 11:19:46.705744 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 127/254] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:46 2022] GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697 => generated 1521 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:47.231044 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-fefb4220-75ef-4f9a-89d2-4f900d522280 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:47.241903 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-fefb4220-75ef-4f9a-89d2-4f900d522280 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:47.243784 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-fefb4220-75ef-4f9a-89d2-4f900d522280 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:47.249685 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-fefb4220-75ef-4f9a-89d2-4f900d522280 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1722 microversion: 2.20 time: 0.575256 Aug 09 11:19:47.250375 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 128/255] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:19:46 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1722 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:19:47.257648 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-33373c4a-77fb-47a7-b30f-ac6c03d94aca tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:47.258565 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-33373c4a-77fb-47a7-b30f-ac6c03d94aca tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] [instance: 14c1cdbe-3b15-499a-88b5-7f86dfc5501b] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:47.265034 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-33373c4a-77fb-47a7-b30f-ac6c03d94aca tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:47.266588 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-33373c4a-77fb-47a7-b30f-ac6c03d94aca tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:47.267383 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-33373c4a-77fb-47a7-b30f-ac6c03d94aca tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:47.268358 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-33373c4a-77fb-47a7-b30f-ac6c03d94aca tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:47.269085 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-33373c4a-77fb-47a7-b30f-ac6c03d94aca tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:47.269711 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-33373c4a-77fb-47a7-b30f-ac6c03d94aca tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:47.295671 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-4688a6c7-a0d1-4b39-a08c-62e9fc952389 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Action: 'create', calling method: .version_select at 0x7f28220cd700>, body: {"keypair": {"name": "tempest-TestShelveInstance-1363296231", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNv9UjlacHazXWx62Rrsy+ZkFD6Gx4oJNBUE3hLXQbKRR2+l58hUeSaSX+ujSuIkhxaMrUsBXDCgqDCG4Ugk7wnfMutT8n5Rf4Wd0hnA9j5DGQlOOvlSvVPbjk6Imxcqyg=="}} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:19:47.322581 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.quota [None req-4688a6c7-a0d1-4b39-a08c-62e9fc952389 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Getting quotas for project 821c49e74c4e4767b872c300ac829345. Resources: {'key_pairs'} {{(pid=117684) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:19:47.327209 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.quota [None req-4688a6c7-a0d1-4b39-a08c-62e9fc952389 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Getting quotas for user 0fb97bc956b14342990b1dd5d8c7be95 and project 821c49e74c4e4767b872c300ac829345. Resources: {'key_pairs'} {{(pid=117684) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:19:47.361729 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-4688a6c7-a0d1-4b39-a08c-62e9fc952389 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.631966 Aug 09 11:19:47.363928 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 128/256] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 9 11:19:46 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:19:47.454350 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-33373c4a-77fb-47a7-b30f-ac6c03d94aca tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff3135cc1482461caf69068b659f49e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2f6acb3c3a4b24be797a677d868227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:47.467106 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-33373c4a-77fb-47a7-b30f-ac6c03d94aca tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] 10.222.0.27 "GET /compute/v2.1/servers/14c1cdbe-3b15-499a-88b5-7f86dfc5501b" status: 200 len: 1318 microversion: 2.1 time: 0.213952 Aug 09 11:19:47.469858 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 129/257] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:47 2022] GET /compute/v2.1/servers/14c1cdbe-3b15-499a-88b5-7f86dfc5501b => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:47.687335 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-1d61f47d-e84a-4dd6-8a81-0755f76d3da1 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:47.688015 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-1d61f47d-e84a-4dd6-8a81-0755f76d3da1 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:47.698893 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1d61f47d-e84a-4dd6-8a81-0755f76d3da1 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:47.700131 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1d61f47d-e84a-4dd6-8a81-0755f76d3da1 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:47.700835 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1d61f47d-e84a-4dd6-8a81-0755f76d3da1 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:47.701761 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1d61f47d-e84a-4dd6-8a81-0755f76d3da1 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:47.702388 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1d61f47d-e84a-4dd6-8a81-0755f76d3da1 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:47.703472 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1d61f47d-e84a-4dd6-8a81-0755f76d3da1 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:47.729201 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-308ae4a9-31fa-455b-9194-71f6476f0025 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:47.730325 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-308ae4a9-31fa-455b-9194-71f6476f0025 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:47.746948 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-308ae4a9-31fa-455b-9194-71f6476f0025 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:47.748549 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-308ae4a9-31fa-455b-9194-71f6476f0025 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:47.749124 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-308ae4a9-31fa-455b-9194-71f6476f0025 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:47.750954 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-308ae4a9-31fa-455b-9194-71f6476f0025 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:47.752354 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-308ae4a9-31fa-455b-9194-71f6476f0025 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:47.755154 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-308ae4a9-31fa-455b-9194-71f6476f0025 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:47.992225 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-1d61f47d-e84a-4dd6-8a81-0755f76d3da1 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:48.013701 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-1d61f47d-e84a-4dd6-8a81-0755f76d3da1 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1723 microversion: 2.1 time: 0.324140 Aug 09 11:19:48.016513 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 129/258] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:47 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1723 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:48.273760 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-5e6a5da6-5d7c-40e0-bc50-b675a6558fcc tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:48.274723 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-5e6a5da6-5d7c-40e0-bc50-b675a6558fcc tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:48.287442 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5e6a5da6-5d7c-40e0-bc50-b675a6558fcc tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:48.295236 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5e6a5da6-5d7c-40e0-bc50-b675a6558fcc tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:48.298129 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5e6a5da6-5d7c-40e0-bc50-b675a6558fcc tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:48.307923 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5e6a5da6-5d7c-40e0-bc50-b675a6558fcc tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:48.311852 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5e6a5da6-5d7c-40e0-bc50-b675a6558fcc tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:48.312432 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5e6a5da6-5d7c-40e0-bc50-b675a6558fcc tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:48.852500 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-308ae4a9-31fa-455b-9194-71f6476f0025 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:48.862267 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-308ae4a9-31fa-455b-9194-71f6476f0025 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697" status: 200 len: 1521 microversion: 2.1 time: 1.137179 Aug 09 11:19:48.862886 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 130/259] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:47 2022] GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697 => generated 1521 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:19:48.872661 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-638b74ad-bcae-433b-a482-7c158c1525ba tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:48.873265 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-638b74ad-bcae-433b-a482-7c158c1525ba tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] [instance: 14c1cdbe-3b15-499a-88b5-7f86dfc5501b] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:48.894032 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-638b74ad-bcae-433b-a482-7c158c1525ba tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:48.894516 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-638b74ad-bcae-433b-a482-7c158c1525ba tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:48.894942 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-638b74ad-bcae-433b-a482-7c158c1525ba tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:48.895634 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-638b74ad-bcae-433b-a482-7c158c1525ba tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:48.896072 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-638b74ad-bcae-433b-a482-7c158c1525ba tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:48.908317 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-638b74ad-bcae-433b-a482-7c158c1525ba tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:48.976053 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-5e6a5da6-5d7c-40e0-bc50-b675a6558fcc tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:48.998035 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-5e6a5da6-5d7c-40e0-bc50-b675a6558fcc tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:48.999902 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-5e6a5da6-5d7c-40e0-bc50-b675a6558fcc tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:49.003784 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-5e6a5da6-5d7c-40e0-bc50-b675a6558fcc tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1722 microversion: 2.20 time: 0.734474 Aug 09 11:19:49.015760 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 130/260] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:19:48 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1722 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:19:49.034738 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-c46651ad-947c-41f8-be47-3a55b0eb23cd tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Action: 'create', calling method: .version_select at 0x7f28220cd8b0>, body: {"keypair": {"name": "tempest-keypair-1200039219", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4mQDm1e4r1zh4F0q1/SSeyHFU7gN8p+hE3v8/Pqjg2CB1wJjGRPG/4Xs3mhV8LH4uJyVYGyVzwunKA4uHhjrdnzqE4mAr39QiS+mZZ2bi7xduJ3t2tq8cZdrtqpaDr8A=="}} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:19:49.056089 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:49.080485 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.quota [None req-c46651ad-947c-41f8-be47-3a55b0eb23cd tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Getting quotas for project cba1dd0b689b4fff847b6fd3787b143c. Resources: {'key_pairs'} {{(pid=117684) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:19:49.093442 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.quota [None req-c46651ad-947c-41f8-be47-3a55b0eb23cd tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Getting quotas for user f4da6dd860bb45d1a703a18c2512ffe4 and project cba1dd0b689b4fff847b6fd3787b143c. Resources: {'key_pairs'} {{(pid=117684) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:19:49.141536 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-c46651ad-947c-41f8-be47-3a55b0eb23cd tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.124460 Aug 09 11:19:49.142506 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 131/261] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 9 11:19:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:19:49.147183 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-9d83188c-6bd7-4b24-9c5b-81ef94ee83d1 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:49.147802 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-9d83188c-6bd7-4b24-9c5b-81ef94ee83d1 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:49.157345 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9d83188c-6bd7-4b24-9c5b-81ef94ee83d1 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:49.157836 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9d83188c-6bd7-4b24-9c5b-81ef94ee83d1 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:49.158275 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9d83188c-6bd7-4b24-9c5b-81ef94ee83d1 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:49.158988 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9d83188c-6bd7-4b24-9c5b-81ef94ee83d1 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:49.159478 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9d83188c-6bd7-4b24-9c5b-81ef94ee83d1 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:49.159849 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9d83188c-6bd7-4b24-9c5b-81ef94ee83d1 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:49.483246 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-638b74ad-bcae-433b-a482-7c158c1525ba tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff3135cc1482461caf69068b659f49e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2f6acb3c3a4b24be797a677d868227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:49.493698 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-638b74ad-bcae-433b-a482-7c158c1525ba tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] 10.222.0.27 "GET /compute/v2.1/servers/14c1cdbe-3b15-499a-88b5-7f86dfc5501b" status: 200 len: 1318 microversion: 2.1 time: 0.629732 Aug 09 11:19:49.496343 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 131/262] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:48 2022] GET /compute/v2.1/servers/14c1cdbe-3b15-499a-88b5-7f86dfc5501b => generated 1318 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:49.601961 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-9d83188c-6bd7-4b24-9c5b-81ef94ee83d1 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:49.613058 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-9d83188c-6bd7-4b24-9c5b-81ef94ee83d1 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1723 microversion: 2.1 time: 0.469484 Aug 09 11:19:49.625852 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 132/263] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:49 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1723 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:49.885949 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-364fc5bf-528f-44a7-ac30-cdc1582a2657 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:49.887532 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-364fc5bf-528f-44a7-ac30-cdc1582a2657 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:49.900925 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-364fc5bf-528f-44a7-ac30-cdc1582a2657 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:49.902659 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-364fc5bf-528f-44a7-ac30-cdc1582a2657 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:49.905262 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-364fc5bf-528f-44a7-ac30-cdc1582a2657 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:49.907257 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-364fc5bf-528f-44a7-ac30-cdc1582a2657 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:49.928939 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-364fc5bf-528f-44a7-ac30-cdc1582a2657 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:49.929476 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-364fc5bf-528f-44a7-ac30-cdc1582a2657 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:50.027961 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-f5b5968c-23e1-42b8-be53-bd2a0432b79f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:50.028620 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-f5b5968c-23e1-42b8-be53-bd2a0432b79f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:50.035424 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f5b5968c-23e1-42b8-be53-bd2a0432b79f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:50.035993 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f5b5968c-23e1-42b8-be53-bd2a0432b79f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:50.040408 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f5b5968c-23e1-42b8-be53-bd2a0432b79f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:50.041245 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f5b5968c-23e1-42b8-be53-bd2a0432b79f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:50.041723 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f5b5968c-23e1-42b8-be53-bd2a0432b79f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:50.042159 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f5b5968c-23e1-42b8-be53-bd2a0432b79f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:50.275949 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-364fc5bf-528f-44a7-ac30-cdc1582a2657 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:50.286078 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-364fc5bf-528f-44a7-ac30-cdc1582a2657 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697" status: 200 len: 1521 microversion: 2.1 time: 0.406393 Aug 09 11:19:50.301128 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 132/264] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:49 2022] GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697 => generated 1521 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:50.327252 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-f5b5968c-23e1-42b8-be53-bd2a0432b79f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:50.342479 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-f5b5968c-23e1-42b8-be53-bd2a0432b79f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:50.348888 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-f5b5968c-23e1-42b8-be53-bd2a0432b79f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:50.352563 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-f5b5968c-23e1-42b8-be53-bd2a0432b79f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1722 microversion: 2.20 time: 0.328653 Aug 09 11:19:50.356589 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 133/265] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:19:50 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1722 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 11:19:50.520728 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-12e8da0e-8bd5-479a-b61d-e95f0f64ae3c tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:50.524989 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-12e8da0e-8bd5-479a-b61d-e95f0f64ae3c tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] [instance: 14c1cdbe-3b15-499a-88b5-7f86dfc5501b] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:50.537352 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-12e8da0e-8bd5-479a-b61d-e95f0f64ae3c tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:50.538121 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-12e8da0e-8bd5-479a-b61d-e95f0f64ae3c tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:50.538761 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-12e8da0e-8bd5-479a-b61d-e95f0f64ae3c tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:50.540525 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-12e8da0e-8bd5-479a-b61d-e95f0f64ae3c tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:50.541508 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-12e8da0e-8bd5-479a-b61d-e95f0f64ae3c tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:50.544056 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-12e8da0e-8bd5-479a-b61d-e95f0f64ae3c tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:50.642665 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-54652225-8cac-4d97-b04a-729843755910 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:50.644161 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-54652225-8cac-4d97-b04a-729843755910 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:50.654653 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-54652225-8cac-4d97-b04a-729843755910 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:50.655145 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-54652225-8cac-4d97-b04a-729843755910 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:50.658271 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-54652225-8cac-4d97-b04a-729843755910 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:50.659006 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-54652225-8cac-4d97-b04a-729843755910 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:50.659468 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-54652225-8cac-4d97-b04a-729843755910 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:50.659901 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-54652225-8cac-4d97-b04a-729843755910 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:51.004483 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-12e8da0e-8bd5-479a-b61d-e95f0f64ae3c tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff3135cc1482461caf69068b659f49e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2f6acb3c3a4b24be797a677d868227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:51.014617 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-12e8da0e-8bd5-479a-b61d-e95f0f64ae3c tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] 10.222.0.27 "GET /compute/v2.1/servers/14c1cdbe-3b15-499a-88b5-7f86dfc5501b" status: 200 len: 1318 microversion: 2.1 time: 0.498545 Aug 09 11:19:51.022864 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 133/266] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:50 2022] GET /compute/v2.1/servers/14c1cdbe-3b15-499a-88b5-7f86dfc5501b => generated 1318 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:51.028306 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-91aad1c3-a492-494d-9e73-7c73b923b6e2 req-490a4b13-7481-4cb2-bef8-dac864da0329 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14c1cdbe-3b15-499a-88b5-7f86dfc5501b", "name": "network-vif-plugged", "status": "completed", "tag": "c1c36676-90bc-4859-a8f2-d09c6b02519b"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:19:51.059720 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-91aad1c3-a492-494d-9e73-7c73b923b6e2 req-490a4b13-7481-4cb2-bef8-dac864da0329 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:51.063253 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-91aad1c3-a492-494d-9e73-7c73b923b6e2 req-490a4b13-7481-4cb2-bef8-dac864da0329 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:51.064854 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-91aad1c3-a492-494d-9e73-7c73b923b6e2 req-490a4b13-7481-4cb2-bef8-dac864da0329 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:51.094760 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-91aad1c3-a492-494d-9e73-7c73b923b6e2 req-490a4b13-7481-4cb2-bef8-dac864da0329 service nova] Creating event network-vif-plugged:c1c36676-90bc-4859-a8f2-d09c6b02519b for instance 14c1cdbe-3b15-499a-88b5-7f86dfc5501b on hv-cinder-85251 Aug 09 11:19:51.116762 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-54652225-8cac-4d97-b04a-729843755910 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:51.125046 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-91aad1c3-a492-494d-9e73-7c73b923b6e2 req-490a4b13-7481-4cb2-bef8-dac864da0329 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100330 Aug 09 11:19:51.127466 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 134/267] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:19:51.129014 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-54652225-8cac-4d97-b04a-729843755910 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1723 microversion: 2.1 time: 0.492244 Aug 09 11:19:51.137797 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 134/268] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:50 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1723 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:51.323624 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-30d32038-a40e-4cd1-a0ac-88fcd11895ad tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:51.324883 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-30d32038-a40e-4cd1-a0ac-88fcd11895ad tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:51.340809 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-30d32038-a40e-4cd1-a0ac-88fcd11895ad tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:51.350089 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-30d32038-a40e-4cd1-a0ac-88fcd11895ad tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:51.350754 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-30d32038-a40e-4cd1-a0ac-88fcd11895ad tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:51.351236 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-30d32038-a40e-4cd1-a0ac-88fcd11895ad tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:51.351714 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-30d32038-a40e-4cd1-a0ac-88fcd11895ad tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:51.352140 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-30d32038-a40e-4cd1-a0ac-88fcd11895ad tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:51.382891 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-126008f0-db7f-4ed1-88b7-cbc3787b3326 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:51.383801 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-126008f0-db7f-4ed1-88b7-cbc3787b3326 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:51.413232 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-126008f0-db7f-4ed1-88b7-cbc3787b3326 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:51.416155 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-126008f0-db7f-4ed1-88b7-cbc3787b3326 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:51.425103 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-126008f0-db7f-4ed1-88b7-cbc3787b3326 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:51.426327 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-126008f0-db7f-4ed1-88b7-cbc3787b3326 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:51.427081 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-126008f0-db7f-4ed1-88b7-cbc3787b3326 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:51.427829 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-126008f0-db7f-4ed1-88b7-cbc3787b3326 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:51.698309 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-30d32038-a40e-4cd1-a0ac-88fcd11895ad tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:51.707740 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-30d32038-a40e-4cd1-a0ac-88fcd11895ad tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697" status: 200 len: 1521 microversion: 2.1 time: 0.401512 Aug 09 11:19:51.713479 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 135/269] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:51 2022] GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697 => generated 1521 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:51.746098 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-126008f0-db7f-4ed1-88b7-cbc3787b3326 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:51.761670 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-126008f0-db7f-4ed1-88b7-cbc3787b3326 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:51.764049 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-126008f0-db7f-4ed1-88b7-cbc3787b3326 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:51.772218 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-126008f0-db7f-4ed1-88b7-cbc3787b3326 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1722 microversion: 2.20 time: 0.393511 Aug 09 11:19:51.773333 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 135/270] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:19:51 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1722 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:19:52.044552 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-074f54b1-453a-44a8-b7b4-8e54de508a35 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:52.045901 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-074f54b1-453a-44a8-b7b4-8e54de508a35 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] [instance: 14c1cdbe-3b15-499a-88b5-7f86dfc5501b] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:52.056980 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-074f54b1-453a-44a8-b7b4-8e54de508a35 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:52.063917 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-074f54b1-453a-44a8-b7b4-8e54de508a35 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:52.067479 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-074f54b1-453a-44a8-b7b4-8e54de508a35 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:52.070278 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-074f54b1-453a-44a8-b7b4-8e54de508a35 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:52.070760 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-074f54b1-453a-44a8-b7b4-8e54de508a35 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:52.071506 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-074f54b1-453a-44a8-b7b4-8e54de508a35 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:52.154091 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-a6872520-2701-41d2-b44b-6691cd4be347 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:52.154971 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-a6872520-2701-41d2-b44b-6691cd4be347 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:52.168220 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a6872520-2701-41d2-b44b-6691cd4be347 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:52.174812 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a6872520-2701-41d2-b44b-6691cd4be347 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:52.178855 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a6872520-2701-41d2-b44b-6691cd4be347 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:52.180018 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a6872520-2701-41d2-b44b-6691cd4be347 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:52.184141 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a6872520-2701-41d2-b44b-6691cd4be347 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:52.187513 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a6872520-2701-41d2-b44b-6691cd4be347 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:52.443476 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-074f54b1-453a-44a8-b7b4-8e54de508a35 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff3135cc1482461caf69068b659f49e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2f6acb3c3a4b24be797a677d868227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:52.460774 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-074f54b1-453a-44a8-b7b4-8e54de508a35 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] 10.222.0.27 "GET /compute/v2.1/servers/14c1cdbe-3b15-499a-88b5-7f86dfc5501b" status: 200 len: 1318 microversion: 2.1 time: 0.416884 Aug 09 11:19:52.462724 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 136/271] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:52 2022] GET /compute/v2.1/servers/14c1cdbe-3b15-499a-88b5-7f86dfc5501b => generated 1318 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:52.681784 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-a6872520-2701-41d2-b44b-6691cd4be347 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:52.722473 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-a6872520-2701-41d2-b44b-6691cd4be347 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1723 microversion: 2.1 time: 0.569079 Aug 09 11:19:52.723244 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 136/272] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:52 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1723 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:52.731452 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-8ad28ca7-fcd4-47d1-a00a-05b00c396b5a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:52.733006 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-8ad28ca7-fcd4-47d1-a00a-05b00c396b5a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:52.739897 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8ad28ca7-fcd4-47d1-a00a-05b00c396b5a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:52.740551 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8ad28ca7-fcd4-47d1-a00a-05b00c396b5a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:52.741171 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8ad28ca7-fcd4-47d1-a00a-05b00c396b5a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:52.742168 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8ad28ca7-fcd4-47d1-a00a-05b00c396b5a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:52.742774 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8ad28ca7-fcd4-47d1-a00a-05b00c396b5a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:52.743350 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8ad28ca7-fcd4-47d1-a00a-05b00c396b5a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:52.773316 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-79e09703-6cc4-408c-af53-c43f03b0f4d2 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1291611291", "imageRef": "2321e9a0-fe0f-47fd-9c4b-8868eb5a00af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9bf85ef7-1c92-4e5f-a5b9-fcad7da95bf2"}], "security_groups": [{"name": "tempest-securitygroup--989721840"}], "key_name": "tempest-keypair-1200039219", "user_data": "}} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:19:52.984366 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-8ad28ca7-fcd4-47d1-a00a-05b00c396b5a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:52.994850 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-8ad28ca7-fcd4-47d1-a00a-05b00c396b5a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697" status: 200 len: 1521 microversion: 2.1 time: 0.267293 Aug 09 11:19:52.995446 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 137/273] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:52 2022] GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697 => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:53.000861 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-1c4be43b-af93-4eae-80cb-7569629a6232 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:53.002106 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-1c4be43b-af93-4eae-80cb-7569629a6232 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:53.009887 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1c4be43b-af93-4eae-80cb-7569629a6232 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:53.010655 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1c4be43b-af93-4eae-80cb-7569629a6232 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:53.011350 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1c4be43b-af93-4eae-80cb-7569629a6232 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:53.012647 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1c4be43b-af93-4eae-80cb-7569629a6232 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:53.013429 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1c4be43b-af93-4eae-80cb-7569629a6232 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:53.013725 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1c4be43b-af93-4eae-80cb-7569629a6232 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:53.191128 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-1c4be43b-af93-4eae-80cb-7569629a6232 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:53.200770 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-1c4be43b-af93-4eae-80cb-7569629a6232 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:53.202888 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-1c4be43b-af93-4eae-80cb-7569629a6232 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:53.204325 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-1c4be43b-af93-4eae-80cb-7569629a6232 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1722 microversion: 2.20 time: 0.207078 Aug 09 11:19:53.205019 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 138/274] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:19:52 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1722 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:19:53.487214 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-8de3418c-3db6-481d-b30d-1041dda05631 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:53.487854 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-8de3418c-3db6-481d-b30d-1041dda05631 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] [instance: 14c1cdbe-3b15-499a-88b5-7f86dfc5501b] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:53.494283 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8de3418c-3db6-481d-b30d-1041dda05631 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:53.494980 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8de3418c-3db6-481d-b30d-1041dda05631 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:53.495594 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8de3418c-3db6-481d-b30d-1041dda05631 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:53.496297 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8de3418c-3db6-481d-b30d-1041dda05631 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:53.496754 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8de3418c-3db6-481d-b30d-1041dda05631 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:53.497342 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8de3418c-3db6-481d-b30d-1041dda05631 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:53.646115 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-8de3418c-3db6-481d-b30d-1041dda05631 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff3135cc1482461caf69068b659f49e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2f6acb3c3a4b24be797a677d868227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:53.655204 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-8de3418c-3db6-481d-b30d-1041dda05631 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] 10.222.0.27 "GET /compute/v2.1/servers/14c1cdbe-3b15-499a-88b5-7f86dfc5501b" status: 200 len: 1507 microversion: 2.1 time: 0.171790 Aug 09 11:19:53.656472 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 139/275] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:53 2022] GET /compute/v2.1/servers/14c1cdbe-3b15-499a-88b5-7f86dfc5501b => generated 1507 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:19:53.747482 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-5f9548e9-e8c9-4a5a-88a3-c76a49e74e83 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:53.748602 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-5f9548e9-e8c9-4a5a-88a3-c76a49e74e83 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:53.756575 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5f9548e9-e8c9-4a5a-88a3-c76a49e74e83 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:53.758180 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5f9548e9-e8c9-4a5a-88a3-c76a49e74e83 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:53.758613 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5f9548e9-e8c9-4a5a-88a3-c76a49e74e83 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:53.759511 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5f9548e9-e8c9-4a5a-88a3-c76a49e74e83 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:53.760000 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5f9548e9-e8c9-4a5a-88a3-c76a49e74e83 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:53.760611 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5f9548e9-e8c9-4a5a-88a3-c76a49e74e83 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:53.954855 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-5f9548e9-e8c9-4a5a-88a3-c76a49e74e83 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:53.964136 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-5f9548e9-e8c9-4a5a-88a3-c76a49e74e83 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1723 microversion: 2.1 time: 0.221681 Aug 09 11:19:53.964803 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 140/276] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:53 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:19:54.019846 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-1b098e29-eda1-4c1d-b2e5-423bdf99bec1 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:54.020629 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-1b098e29-eda1-4c1d-b2e5-423bdf99bec1 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:54.031477 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1b098e29-eda1-4c1d-b2e5-423bdf99bec1 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:54.032542 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1b098e29-eda1-4c1d-b2e5-423bdf99bec1 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:54.033214 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1b098e29-eda1-4c1d-b2e5-423bdf99bec1 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:54.036196 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1b098e29-eda1-4c1d-b2e5-423bdf99bec1 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:54.036196 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1b098e29-eda1-4c1d-b2e5-423bdf99bec1 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:54.036196 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1b098e29-eda1-4c1d-b2e5-423bdf99bec1 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:54.247780 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-1b098e29-eda1-4c1d-b2e5-423bdf99bec1 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:54.255781 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-1b098e29-eda1-4c1d-b2e5-423bdf99bec1 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697" status: 200 len: 1521 microversion: 2.1 time: 0.240299 Aug 09 11:19:54.257042 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 141/277] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:54 2022] GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697 => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:19:54.261799 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-103790f7-d339-4c9d-b918-47dce51eb82d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:54.262720 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-103790f7-d339-4c9d-b918-47dce51eb82d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:54.282756 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-103790f7-d339-4c9d-b918-47dce51eb82d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:54.283679 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-103790f7-d339-4c9d-b918-47dce51eb82d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:54.285814 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-103790f7-d339-4c9d-b918-47dce51eb82d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:54.288397 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-103790f7-d339-4c9d-b918-47dce51eb82d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:54.289838 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-103790f7-d339-4c9d-b918-47dce51eb82d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:54.290906 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-103790f7-d339-4c9d-b918-47dce51eb82d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:54.501935 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-103790f7-d339-4c9d-b918-47dce51eb82d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:54.514940 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-103790f7-d339-4c9d-b918-47dce51eb82d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:54.517319 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-103790f7-d339-4c9d-b918-47dce51eb82d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:54.518898 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-103790f7-d339-4c9d-b918-47dce51eb82d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1722 microversion: 2.20 time: 0.260945 Aug 09 11:19:54.519566 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 142/278] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:19:54 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1722 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:19:54.994393 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-bf3897d8-767f-47c9-8131-fbb99186b23b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:54.996059 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-bf3897d8-767f-47c9-8131-fbb99186b23b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:55.003608 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bf3897d8-767f-47c9-8131-fbb99186b23b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:55.004047 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bf3897d8-767f-47c9-8131-fbb99186b23b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:55.004522 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bf3897d8-767f-47c9-8131-fbb99186b23b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:55.005251 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bf3897d8-767f-47c9-8131-fbb99186b23b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:55.005924 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bf3897d8-767f-47c9-8131-fbb99186b23b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:55.006581 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bf3897d8-767f-47c9-8131-fbb99186b23b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:55.183330 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-bf3897d8-767f-47c9-8131-fbb99186b23b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:55.187131 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:55.193647 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-bf3897d8-767f-47c9-8131-fbb99186b23b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1723 microversion: 2.1 time: 0.209735 Aug 09 11:19:55.194672 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 143/279] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:54 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1723 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:19:55.280169 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-070f7ab8-4797-4e4c-a113-36a06288f3bc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:55.280949 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-070f7ab8-4797-4e4c-a113-36a06288f3bc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:55.288360 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-070f7ab8-4797-4e4c-a113-36a06288f3bc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:55.288966 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-070f7ab8-4797-4e4c-a113-36a06288f3bc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:55.289511 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-070f7ab8-4797-4e4c-a113-36a06288f3bc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:55.290416 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-070f7ab8-4797-4e4c-a113-36a06288f3bc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:55.290877 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-070f7ab8-4797-4e4c-a113-36a06288f3bc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:55.291310 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-070f7ab8-4797-4e4c-a113-36a06288f3bc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:55.446783 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-070f7ab8-4797-4e4c-a113-36a06288f3bc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:55.454922 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-070f7ab8-4797-4e4c-a113-36a06288f3bc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697" status: 200 len: 1521 microversion: 2.1 time: 0.179240 Aug 09 11:19:55.455471 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 144/280] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:55 2022] GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:55.556331 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-1103e73f-23a4-4b84-9697-0bbfc7666102 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:55.556331 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-1103e73f-23a4-4b84-9697-0bbfc7666102 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:55.606386 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1103e73f-23a4-4b84-9697-0bbfc7666102 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:55.608882 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1103e73f-23a4-4b84-9697-0bbfc7666102 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:55.609544 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1103e73f-23a4-4b84-9697-0bbfc7666102 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:55.611046 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1103e73f-23a4-4b84-9697-0bbfc7666102 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:55.616481 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1103e73f-23a4-4b84-9697-0bbfc7666102 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:55.617268 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1103e73f-23a4-4b84-9697-0bbfc7666102 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:55.805486 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-1103e73f-23a4-4b84-9697-0bbfc7666102 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:55.814390 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-1103e73f-23a4-4b84-9697-0bbfc7666102 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:55.816000 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-1103e73f-23a4-4b84-9697-0bbfc7666102 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:55.817272 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-1103e73f-23a4-4b84-9697-0bbfc7666102 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1722 microversion: 2.20 time: 0.273927 Aug 09 11:19:55.820332 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 145/281] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:19:55 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1722 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:19:56.219873 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-f1e5aac7-7f33-4a31-97a0-41e2f15bf505 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:56.220756 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-f1e5aac7-7f33-4a31-97a0-41e2f15bf505 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:56.230901 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f1e5aac7-7f33-4a31-97a0-41e2f15bf505 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:56.231384 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f1e5aac7-7f33-4a31-97a0-41e2f15bf505 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:56.231812 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f1e5aac7-7f33-4a31-97a0-41e2f15bf505 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:56.232536 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f1e5aac7-7f33-4a31-97a0-41e2f15bf505 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:56.232978 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f1e5aac7-7f33-4a31-97a0-41e2f15bf505 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:56.233391 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f1e5aac7-7f33-4a31-97a0-41e2f15bf505 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:56.393720 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-f1e5aac7-7f33-4a31-97a0-41e2f15bf505 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:56.405285 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-f1e5aac7-7f33-4a31-97a0-41e2f15bf505 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1723 microversion: 2.1 time: 0.190250 Aug 09 11:19:56.417241 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 146/282] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:56 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:56.477368 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-c851314c-d742-4dce-b692-8d9c5c677f6d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:56.477888 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-c851314c-d742-4dce-b692-8d9c5c677f6d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:56.484043 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c851314c-d742-4dce-b692-8d9c5c677f6d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:56.484575 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c851314c-d742-4dce-b692-8d9c5c677f6d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:56.485439 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c851314c-d742-4dce-b692-8d9c5c677f6d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:56.486318 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c851314c-d742-4dce-b692-8d9c5c677f6d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:56.487059 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c851314c-d742-4dce-b692-8d9c5c677f6d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:56.487059 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c851314c-d742-4dce-b692-8d9c5c677f6d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:56.653572 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-c851314c-d742-4dce-b692-8d9c5c677f6d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:56.663570 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-c851314c-d742-4dce-b692-8d9c5c677f6d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697" status: 200 len: 1521 microversion: 2.1 time: 0.189671 Aug 09 11:19:56.664361 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 147/283] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:56 2022] GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:19:56.841383 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-f7e31e6c-7d78-42db-a394-f06b46598cf9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:56.842167 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-f7e31e6c-7d78-42db-a394-f06b46598cf9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:56.848624 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f7e31e6c-7d78-42db-a394-f06b46598cf9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:56.849110 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f7e31e6c-7d78-42db-a394-f06b46598cf9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:56.849542 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f7e31e6c-7d78-42db-a394-f06b46598cf9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:56.850422 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f7e31e6c-7d78-42db-a394-f06b46598cf9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:56.850795 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f7e31e6c-7d78-42db-a394-f06b46598cf9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:56.851217 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f7e31e6c-7d78-42db-a394-f06b46598cf9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:57.054412 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-f7e31e6c-7d78-42db-a394-f06b46598cf9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:57.063957 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-f7e31e6c-7d78-42db-a394-f06b46598cf9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:57.065824 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-f7e31e6c-7d78-42db-a394-f06b46598cf9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:57.067269 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-f7e31e6c-7d78-42db-a394-f06b46598cf9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1722 microversion: 2.20 time: 0.229818 Aug 09 11:19:57.077735 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 148/284] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:19:56 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 11:19:57.428532 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-b55cd22d-6db6-4615-85e1-06c9071f4e07 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:57.429468 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-b55cd22d-6db6-4615-85e1-06c9071f4e07 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:57.438611 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b55cd22d-6db6-4615-85e1-06c9071f4e07 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:57.439598 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b55cd22d-6db6-4615-85e1-06c9071f4e07 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:57.440421 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b55cd22d-6db6-4615-85e1-06c9071f4e07 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:57.441288 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b55cd22d-6db6-4615-85e1-06c9071f4e07 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:57.441807 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b55cd22d-6db6-4615-85e1-06c9071f4e07 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:57.442975 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b55cd22d-6db6-4615-85e1-06c9071f4e07 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:57.597764 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-b55cd22d-6db6-4615-85e1-06c9071f4e07 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:57.608158 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-b55cd22d-6db6-4615-85e1-06c9071f4e07 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1723 microversion: 2.1 time: 0.184314 Aug 09 11:19:57.624401 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 149/285] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:57 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:57.685324 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-28ceeca7-ad33-45c9-a6b5-53b6227b6b57 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:57.685848 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-28ceeca7-ad33-45c9-a6b5-53b6227b6b57 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:57.692127 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-28ceeca7-ad33-45c9-a6b5-53b6227b6b57 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:57.692656 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-28ceeca7-ad33-45c9-a6b5-53b6227b6b57 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:57.693083 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-28ceeca7-ad33-45c9-a6b5-53b6227b6b57 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:57.694247 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-28ceeca7-ad33-45c9-a6b5-53b6227b6b57 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:57.694519 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-28ceeca7-ad33-45c9-a6b5-53b6227b6b57 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:57.694978 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-28ceeca7-ad33-45c9-a6b5-53b6227b6b57 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:57.872174 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-28ceeca7-ad33-45c9-a6b5-53b6227b6b57 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:57.880178 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-28ceeca7-ad33-45c9-a6b5-53b6227b6b57 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697" status: 200 len: 1521 microversion: 2.1 time: 0.198866 Aug 09 11:19:57.880798 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 150/286] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:57 2022] GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:19:58.091198 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-2ae3f7ea-4e9d-475b-9f9b-82f28bb18c8c tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:58.091809 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-2ae3f7ea-4e9d-475b-9f9b-82f28bb18c8c tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:58.098243 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2ae3f7ea-4e9d-475b-9f9b-82f28bb18c8c tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:58.098726 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2ae3f7ea-4e9d-475b-9f9b-82f28bb18c8c tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:58.099343 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2ae3f7ea-4e9d-475b-9f9b-82f28bb18c8c tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:58.100175 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2ae3f7ea-4e9d-475b-9f9b-82f28bb18c8c tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:58.100576 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2ae3f7ea-4e9d-475b-9f9b-82f28bb18c8c tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:58.101058 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2ae3f7ea-4e9d-475b-9f9b-82f28bb18c8c tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:58.270139 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-2ae3f7ea-4e9d-475b-9f9b-82f28bb18c8c tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:58.281872 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-2ae3f7ea-4e9d-475b-9f9b-82f28bb18c8c tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:58.284625 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-2ae3f7ea-4e9d-475b-9f9b-82f28bb18c8c tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:58.288529 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-2ae3f7ea-4e9d-475b-9f9b-82f28bb18c8c tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1743 microversion: 2.20 time: 0.201403 Aug 09 11:19:58.290268 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 151/287] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:19:58 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1743 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:19:58.636831 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-dd4ab470-57ac-4863-8283-3c3d5ae22c59 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:58.638171 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-dd4ab470-57ac-4863-8283-3c3d5ae22c59 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:58.645101 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-dd4ab470-57ac-4863-8283-3c3d5ae22c59 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:58.646219 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-dd4ab470-57ac-4863-8283-3c3d5ae22c59 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:58.646903 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-dd4ab470-57ac-4863-8283-3c3d5ae22c59 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:58.648067 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-dd4ab470-57ac-4863-8283-3c3d5ae22c59 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:58.648533 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-dd4ab470-57ac-4863-8283-3c3d5ae22c59 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:58.649182 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-dd4ab470-57ac-4863-8283-3c3d5ae22c59 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:58.841633 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-dd4ab470-57ac-4863-8283-3c3d5ae22c59 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:58.857467 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-dd4ab470-57ac-4863-8283-3c3d5ae22c59 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1723 microversion: 2.1 time: 0.223396 Aug 09 11:19:58.858307 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 152/288] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:58 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:19:58.902836 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-7f0f6544-cf7c-46c9-97f6-f478df1e07ec tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:58.903755 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-7f0f6544-cf7c-46c9-97f6-f478df1e07ec tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:58.917612 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7f0f6544-cf7c-46c9-97f6-f478df1e07ec tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:58.918127 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7f0f6544-cf7c-46c9-97f6-f478df1e07ec tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:58.918998 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7f0f6544-cf7c-46c9-97f6-f478df1e07ec tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:58.919925 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7f0f6544-cf7c-46c9-97f6-f478df1e07ec tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:58.920402 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7f0f6544-cf7c-46c9-97f6-f478df1e07ec tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:58.920835 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7f0f6544-cf7c-46c9-97f6-f478df1e07ec tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:59.070833 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-7f0f6544-cf7c-46c9-97f6-f478df1e07ec tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:59.078567 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-7f0f6544-cf7c-46c9-97f6-f478df1e07ec tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697" status: 200 len: 1521 microversion: 2.1 time: 0.179968 Aug 09 11:19:59.079120 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 153/289] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:58 2022] GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:59.112060 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell0:SELECT=8 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:59.314207 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-6347422f-b470-4dd6-ab84-b7e49eb800fd tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:59.315042 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-6347422f-b470-4dd6-ab84-b7e49eb800fd tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:59.322718 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6347422f-b470-4dd6-ab84-b7e49eb800fd tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:59.323379 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6347422f-b470-4dd6-ab84-b7e49eb800fd tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:59.323888 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6347422f-b470-4dd6-ab84-b7e49eb800fd tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:59.324709 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6347422f-b470-4dd6-ab84-b7e49eb800fd tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:59.325433 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6347422f-b470-4dd6-ab84-b7e49eb800fd tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:59.326085 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6347422f-b470-4dd6-ab84-b7e49eb800fd tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:59.463332 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-6347422f-b470-4dd6-ab84-b7e49eb800fd tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:59.471727 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-6347422f-b470-4dd6-ab84-b7e49eb800fd tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:59.473395 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-6347422f-b470-4dd6-ab84-b7e49eb800fd tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:19:59.474681 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-6347422f-b470-4dd6-ab84-b7e49eb800fd tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1743 microversion: 2.20 time: 0.164673 Aug 09 11:19:59.475462 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 154/290] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:19:59 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1743 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 11:19:59.888390 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-33721005-7411-41c9-868b-b78e8c3088c9 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:59.889025 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-33721005-7411-41c9-868b-b78e8c3088c9 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:19:59.896516 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-33721005-7411-41c9-868b-b78e8c3088c9 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:59.897300 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-33721005-7411-41c9-868b-b78e8c3088c9 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:59.897979 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-33721005-7411-41c9-868b-b78e8c3088c9 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:19:59.898888 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-33721005-7411-41c9-868b-b78e8c3088c9 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:19:59.899999 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-33721005-7411-41c9-868b-b78e8c3088c9 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:19:59.900759 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-33721005-7411-41c9-868b-b78e8c3088c9 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:00.049056 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-33721005-7411-41c9-868b-b78e8c3088c9 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:00.058200 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-33721005-7411-41c9-868b-b78e8c3088c9 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1723 microversion: 2.1 time: 0.174731 Aug 09 11:20:00.059328 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 155/291] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:19:59 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:20:00.101934 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-7a1a4fdc-2f91-4f54-94e0-e193b0f05d54 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:00.102943 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-7a1a4fdc-2f91-4f54-94e0-e193b0f05d54 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:00.109306 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7a1a4fdc-2f91-4f54-94e0-e193b0f05d54 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:00.109861 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7a1a4fdc-2f91-4f54-94e0-e193b0f05d54 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:00.110512 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7a1a4fdc-2f91-4f54-94e0-e193b0f05d54 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:00.111570 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7a1a4fdc-2f91-4f54-94e0-e193b0f05d54 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:00.112219 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7a1a4fdc-2f91-4f54-94e0-e193b0f05d54 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:00.112739 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7a1a4fdc-2f91-4f54-94e0-e193b0f05d54 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:00.266295 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-7a1a4fdc-2f91-4f54-94e0-e193b0f05d54 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:00.276495 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-7a1a4fdc-2f91-4f54-94e0-e193b0f05d54 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697" status: 200 len: 1521 microversion: 2.1 time: 0.178631 Aug 09 11:20:00.280645 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 156/292] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:00 2022] GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:20:00.408660 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-62fa801e-4483-4b3c-9eff-075a2c12d549 req-7ee4fcd3-b56c-499c-a468-82bc4e4cddcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69542c8c-90b6-49a4-aed3-c229168f215f", "name": "network-vif-plugged", "status": "completed", "tag": "e9e1072a-3971-440e-9a60-ba15e5db60f3"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:20:00.422868 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-62fa801e-4483-4b3c-9eff-075a2c12d549 req-7ee4fcd3-b56c-499c-a468-82bc4e4cddcc service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:00.423598 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-62fa801e-4483-4b3c-9eff-075a2c12d549 req-7ee4fcd3-b56c-499c-a468-82bc4e4cddcc service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:00.424181 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-62fa801e-4483-4b3c-9eff-075a2c12d549 req-7ee4fcd3-b56c-499c-a468-82bc4e4cddcc service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:00.438267 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-62fa801e-4483-4b3c-9eff-075a2c12d549 req-7ee4fcd3-b56c-499c-a468-82bc4e4cddcc service nova] Creating event network-vif-plugged:e9e1072a-3971-440e-9a60-ba15e5db60f3 for instance 69542c8c-90b6-49a4-aed3-c229168f215f on hv-cinder-85251 Aug 09 11:20:00.446504 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-62fa801e-4483-4b3c-9eff-075a2c12d549 req-7ee4fcd3-b56c-499c-a468-82bc4e4cddcc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041415 Aug 09 11:20:00.447125 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 157/293] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:20:00.502126 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-40888c35-943e-4eeb-9af0-fd7138391827 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:00.502813 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-40888c35-943e-4eeb-9af0-fd7138391827 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:00.511278 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-40888c35-943e-4eeb-9af0-fd7138391827 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:00.511737 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-40888c35-943e-4eeb-9af0-fd7138391827 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:00.514400 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-40888c35-943e-4eeb-9af0-fd7138391827 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:00.515129 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-40888c35-943e-4eeb-9af0-fd7138391827 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:00.515593 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-40888c35-943e-4eeb-9af0-fd7138391827 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:00.516066 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-40888c35-943e-4eeb-9af0-fd7138391827 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:00.971529 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-40888c35-943e-4eeb-9af0-fd7138391827 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:00.984984 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-40888c35-943e-4eeb-9af0-fd7138391827 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:00.987185 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-40888c35-943e-4eeb-9af0-fd7138391827 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:00.988904 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-40888c35-943e-4eeb-9af0-fd7138391827 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1738 microversion: 2.20 time: 0.491527 Aug 09 11:20:00.995689 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 158/294] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:20:00 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1738 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:20:01.081128 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-fdf41d80-2cd9-42ac-bdcc-214f2cc6cf9d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:01.082272 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-fdf41d80-2cd9-42ac-bdcc-214f2cc6cf9d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:01.089657 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fdf41d80-2cd9-42ac-bdcc-214f2cc6cf9d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:01.090450 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fdf41d80-2cd9-42ac-bdcc-214f2cc6cf9d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:01.090884 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fdf41d80-2cd9-42ac-bdcc-214f2cc6cf9d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:01.091687 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fdf41d80-2cd9-42ac-bdcc-214f2cc6cf9d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:01.092214 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fdf41d80-2cd9-42ac-bdcc-214f2cc6cf9d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:01.092851 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fdf41d80-2cd9-42ac-bdcc-214f2cc6cf9d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:01.256290 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-fdf41d80-2cd9-42ac-bdcc-214f2cc6cf9d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:01.266512 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-fdf41d80-2cd9-42ac-bdcc-214f2cc6cf9d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1723 microversion: 2.1 time: 0.191135 Aug 09 11:20:01.267147 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 159/295] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:01 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:01.302611 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-cb3eb36a-5c9c-42eb-862f-eb0d9ab25b3e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:01.303218 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-cb3eb36a-5c9c-42eb-862f-eb0d9ab25b3e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:01.310143 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-cb3eb36a-5c9c-42eb-862f-eb0d9ab25b3e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:01.310723 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-cb3eb36a-5c9c-42eb-862f-eb0d9ab25b3e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:01.311149 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-cb3eb36a-5c9c-42eb-862f-eb0d9ab25b3e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:01.311991 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-cb3eb36a-5c9c-42eb-862f-eb0d9ab25b3e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:01.312470 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-cb3eb36a-5c9c-42eb-862f-eb0d9ab25b3e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:01.312906 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-cb3eb36a-5c9c-42eb-862f-eb0d9ab25b3e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:01.472935 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-cb3eb36a-5c9c-42eb-862f-eb0d9ab25b3e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:01.481839 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-cb3eb36a-5c9c-42eb-862f-eb0d9ab25b3e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697" status: 200 len: 1521 microversion: 2.1 time: 0.183089 Aug 09 11:20:01.482681 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 160/296] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:01 2022] GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:20:02.020958 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-33e59100-5d16-4513-a0b9-ee8c14fadda5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:02.021709 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-33e59100-5d16-4513-a0b9-ee8c14fadda5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:02.029831 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-33e59100-5d16-4513-a0b9-ee8c14fadda5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:02.031247 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-33e59100-5d16-4513-a0b9-ee8c14fadda5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:02.032218 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-33e59100-5d16-4513-a0b9-ee8c14fadda5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:02.033225 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-33e59100-5d16-4513-a0b9-ee8c14fadda5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:02.033869 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-33e59100-5d16-4513-a0b9-ee8c14fadda5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:02.034444 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-33e59100-5d16-4513-a0b9-ee8c14fadda5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:02.039850 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell1:SELECT=100 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:02.210613 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-33e59100-5d16-4513-a0b9-ee8c14fadda5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:02.222760 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-33e59100-5d16-4513-a0b9-ee8c14fadda5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:02.226226 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-33e59100-5d16-4513-a0b9-ee8c14fadda5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:02.227713 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-33e59100-5d16-4513-a0b9-ee8c14fadda5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1738 microversion: 2.20 time: 0.212254 Aug 09 11:20:02.228434 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 161/297] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:20:02 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1738 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:20:02.290708 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-b947815d-1292-40f2-8049-e0b045def57d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:02.291603 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-b947815d-1292-40f2-8049-e0b045def57d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:02.298800 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b947815d-1292-40f2-8049-e0b045def57d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:02.299637 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b947815d-1292-40f2-8049-e0b045def57d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:02.300065 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b947815d-1292-40f2-8049-e0b045def57d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:02.300976 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b947815d-1292-40f2-8049-e0b045def57d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:02.301542 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b947815d-1292-40f2-8049-e0b045def57d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:02.302028 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b947815d-1292-40f2-8049-e0b045def57d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:02.450791 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-b947815d-1292-40f2-8049-e0b045def57d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:02.459238 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-b947815d-1292-40f2-8049-e0b045def57d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1723 microversion: 2.1 time: 0.172835 Aug 09 11:20:02.460075 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 162/298] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:02 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:20:02.510998 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-78cde133-e48c-4f08-9656-a7720232021f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:02.511706 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-78cde133-e48c-4f08-9656-a7720232021f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:02.519100 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-78cde133-e48c-4f08-9656-a7720232021f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:02.519575 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-78cde133-e48c-4f08-9656-a7720232021f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:02.520004 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-78cde133-e48c-4f08-9656-a7720232021f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:02.520729 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-78cde133-e48c-4f08-9656-a7720232021f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:02.521177 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-78cde133-e48c-4f08-9656-a7720232021f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:02.521624 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-78cde133-e48c-4f08-9656-a7720232021f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:02.675617 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-78cde133-e48c-4f08-9656-a7720232021f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:02.686365 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-78cde133-e48c-4f08-9656-a7720232021f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697" status: 200 len: 1521 microversion: 2.1 time: 0.178920 Aug 09 11:20:02.687427 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 163/299] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:02 2022] GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:20:02.708614 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell1:SELECT=48 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:02.787480 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=1 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:03.250531 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-6fef2481-be44-47ca-837e-ac58e39f3253 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:03.251149 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-6fef2481-be44-47ca-837e-ac58e39f3253 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:03.259543 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6fef2481-be44-47ca-837e-ac58e39f3253 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:03.260089 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6fef2481-be44-47ca-837e-ac58e39f3253 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:03.260548 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6fef2481-be44-47ca-837e-ac58e39f3253 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:03.261265 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6fef2481-be44-47ca-837e-ac58e39f3253 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:03.261726 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6fef2481-be44-47ca-837e-ac58e39f3253 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:03.262144 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6fef2481-be44-47ca-837e-ac58e39f3253 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:03.334292 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.network.neutron [None req-79e09703-6cc4-408c-af53-c43f03b0f4d2 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] validate_networks() for [('9bf85ef7-1c92-4e5f-a5b9-fcad7da95bf2', None, None, None, None, None)] {{(pid=117684) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 11:20:03.507410 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-6fef2481-be44-47ca-837e-ac58e39f3253 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:03.524446 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-6fef2481-be44-47ca-837e-ac58e39f3253 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:03.528060 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-6fef2481-be44-47ca-837e-ac58e39f3253 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:03.530942 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-6fef2481-be44-47ca-837e-ac58e39f3253 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1738 microversion: 2.20 time: 0.283764 Aug 09 11:20:03.531958 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 164/300] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:20:03 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1738 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 11:20:03.537191 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-e8b5c1bd-897d-45a7-b1fa-f7d21782f911 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:03.537802 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-e8b5c1bd-897d-45a7-b1fa-f7d21782f911 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:03.546074 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e8b5c1bd-897d-45a7-b1fa-f7d21782f911 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:03.547074 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e8b5c1bd-897d-45a7-b1fa-f7d21782f911 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:03.547676 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e8b5c1bd-897d-45a7-b1fa-f7d21782f911 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:03.548527 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e8b5c1bd-897d-45a7-b1fa-f7d21782f911 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:03.549132 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e8b5c1bd-897d-45a7-b1fa-f7d21782f911 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:03.549719 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e8b5c1bd-897d-45a7-b1fa-f7d21782f911 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:03.817460 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-e8b5c1bd-897d-45a7-b1fa-f7d21782f911 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:03.829337 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-e8b5c1bd-897d-45a7-b1fa-f7d21782f911 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1723 microversion: 2.1 time: 0.293400 Aug 09 11:20:03.840880 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 165/301] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:03 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1723 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:03.846314 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-59b0ef56-eaa8-4bc2-8312-ef96978df652 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:03.846940 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-59b0ef56-eaa8-4bc2-8312-ef96978df652 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:03.853097 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-59b0ef56-eaa8-4bc2-8312-ef96978df652 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:03.853581 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-59b0ef56-eaa8-4bc2-8312-ef96978df652 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:03.854012 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-59b0ef56-eaa8-4bc2-8312-ef96978df652 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:03.854711 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-59b0ef56-eaa8-4bc2-8312-ef96978df652 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:03.855160 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-59b0ef56-eaa8-4bc2-8312-ef96978df652 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:03.858558 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-59b0ef56-eaa8-4bc2-8312-ef96978df652 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:04.015893 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-79e09703-6cc4-408c-af53-c43f03b0f4d2 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Flavor limits 0:0:0 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 11:20:04.017228 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-79e09703-6cc4-408c-af53-c43f03b0f4d2 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Image limits 0:0:0 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 11:20:04.017921 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-79e09703-6cc4-408c-af53-c43f03b0f4d2 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Flavor pref 0:0:0 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 11:20:04.018517 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-79e09703-6cc4-408c-af53-c43f03b0f4d2 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Image pref 0:0:0 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 11:20:04.019081 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-79e09703-6cc4-408c-af53-c43f03b0f4d2 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 11:20:04.036561 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-79e09703-6cc4-408c-af53-c43f03b0f4d2 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:04.037243 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-79e09703-6cc4-408c-af53-c43f03b0f4d2 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:04.037975 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-79e09703-6cc4-408c-af53-c43f03b0f4d2 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:04.039023 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-79e09703-6cc4-408c-af53-c43f03b0f4d2 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:04.039777 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-79e09703-6cc4-408c-af53-c43f03b0f4d2 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:04.040483 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-79e09703-6cc4-408c-af53-c43f03b0f4d2 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:04.067578 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.quota [None req-79e09703-6cc4-408c-af53-c43f03b0f4d2 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Getting quotas for project cba1dd0b689b4fff847b6fd3787b143c. Resources: {'cores', 'instances', 'ram'} {{(pid=117684) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:20:04.072448 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.quota [None req-79e09703-6cc4-408c-af53-c43f03b0f4d2 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Getting quotas for user f4da6dd860bb45d1a703a18c2512ffe4 and project cba1dd0b689b4fff847b6fd3787b143c. Resources: {'cores', 'instances', 'ram'} {{(pid=117684) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:20:04.085919 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-59b0ef56-eaa8-4bc2-8312-ef96978df652 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:04.093668 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-79e09703-6cc4-408c-af53-c43f03b0f4d2 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Going to run 1 instances... {{(pid=117684) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 11:20:04.097701 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-59b0ef56-eaa8-4bc2-8312-ef96978df652 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697" status: 200 len: 1521 microversion: 2.1 time: 0.254100 Aug 09 11:20:04.097701 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 166/302] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:03 2022] GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697 => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:04.099865 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-79e09703-6cc4-408c-af53-c43f03b0f4d2 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: eee55879-1bf3-41e4-b439-0c903100e828] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2321e9a0-fe0f-47fd-9c4b-8868eb5a00af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117684) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 11:20:04.163987 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-79e09703-6cc4-408c-af53-c43f03b0f4d2 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 11.395137 Aug 09 11:20:04.171371 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 137/303] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 9 11:19:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 11403 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 11:20:04.176428 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-3decf895-22d1-42b8-bf8d-11219ddfd70a tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:04.177292 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-3decf895-22d1-42b8-bf8d-11219ddfd70a tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: eee55879-1bf3-41e4-b439-0c903100e828] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:04.308761 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-3decf895-22d1-42b8-bf8d-11219ddfd70a tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:04.317733 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-3decf895-22d1-42b8-bf8d-11219ddfd70a tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828" status: 200 len: 1242 microversion: 2.1 time: 0.145626 Aug 09 11:20:04.318542 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 167/304] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:04 2022] GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828 => generated 1242 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:20:04.556774 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-0d7e202b-207c-49dd-9e0c-fb434444792e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:04.557953 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-0d7e202b-207c-49dd-9e0c-fb434444792e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:04.572524 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0d7e202b-207c-49dd-9e0c-fb434444792e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:04.573434 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0d7e202b-207c-49dd-9e0c-fb434444792e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:04.574061 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0d7e202b-207c-49dd-9e0c-fb434444792e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:04.575165 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0d7e202b-207c-49dd-9e0c-fb434444792e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:04.575959 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0d7e202b-207c-49dd-9e0c-fb434444792e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:04.576934 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0d7e202b-207c-49dd-9e0c-fb434444792e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:04.784301 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-0d7e202b-207c-49dd-9e0c-fb434444792e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:04.796889 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-0d7e202b-207c-49dd-9e0c-fb434444792e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:04.799908 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-0d7e202b-207c-49dd-9e0c-fb434444792e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:04.801343 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-0d7e202b-207c-49dd-9e0c-fb434444792e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1738 microversion: 2.20 time: 0.249512 Aug 09 11:20:04.802670 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 138/305] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:20:04 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1738 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:20:04.848570 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-11fbf103-ad01-4015-8d3f-6205960bf936 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:04.849593 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-11fbf103-ad01-4015-8d3f-6205960bf936 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:04.857057 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-11fbf103-ad01-4015-8d3f-6205960bf936 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:04.857844 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-11fbf103-ad01-4015-8d3f-6205960bf936 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:04.859406 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-11fbf103-ad01-4015-8d3f-6205960bf936 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:04.861451 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-11fbf103-ad01-4015-8d3f-6205960bf936 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:04.861951 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-11fbf103-ad01-4015-8d3f-6205960bf936 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:04.862422 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-11fbf103-ad01-4015-8d3f-6205960bf936 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:05.040697 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-11fbf103-ad01-4015-8d3f-6205960bf936 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:05.058843 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-11fbf103-ad01-4015-8d3f-6205960bf936 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1723 microversion: 2.1 time: 0.214364 Aug 09 11:20:05.073023 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 168/306] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:04 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:05.117630 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-c16fec24-73c2-469c-bd25-452be41d0031 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:05.118345 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-c16fec24-73c2-469c-bd25-452be41d0031 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:05.124721 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c16fec24-73c2-469c-bd25-452be41d0031 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:05.125210 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c16fec24-73c2-469c-bd25-452be41d0031 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:05.125644 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c16fec24-73c2-469c-bd25-452be41d0031 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:05.136815 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c16fec24-73c2-469c-bd25-452be41d0031 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:05.138330 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c16fec24-73c2-469c-bd25-452be41d0031 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:05.138806 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c16fec24-73c2-469c-bd25-452be41d0031 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:05.298266 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-c16fec24-73c2-469c-bd25-452be41d0031 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:05.306759 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-c16fec24-73c2-469c-bd25-452be41d0031 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697" status: 200 len: 1521 microversion: 2.1 time: 0.192952 Aug 09 11:20:05.307608 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 139/307] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:05 2022] GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:20:05.339710 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-f789f043-849e-4785-abd7-479ff8865927 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:05.341269 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-f789f043-849e-4785-abd7-479ff8865927 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: eee55879-1bf3-41e4-b439-0c903100e828] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:05.348982 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f789f043-849e-4785-abd7-479ff8865927 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:05.349455 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f789f043-849e-4785-abd7-479ff8865927 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:05.350091 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f789f043-849e-4785-abd7-479ff8865927 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:05.352303 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f789f043-849e-4785-abd7-479ff8865927 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:05.352303 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f789f043-849e-4785-abd7-479ff8865927 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:05.352303 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f789f043-849e-4785-abd7-479ff8865927 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:05.424739 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-f789f043-849e-4785-abd7-479ff8865927 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:05.433699 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-f789f043-849e-4785-abd7-479ff8865927 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828" status: 200 len: 1294 microversion: 2.1 time: 0.098222 Aug 09 11:20:05.434555 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 169/308] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:05 2022] GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828 => generated 1294 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:05.828466 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-42bedf66-c4ee-4a95-8eb5-1392e4e3ee51 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:05.829380 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-42bedf66-c4ee-4a95-8eb5-1392e4e3ee51 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:05.839998 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-42bedf66-c4ee-4a95-8eb5-1392e4e3ee51 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:05.840907 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-42bedf66-c4ee-4a95-8eb5-1392e4e3ee51 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:05.841562 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-42bedf66-c4ee-4a95-8eb5-1392e4e3ee51 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:05.842620 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-42bedf66-c4ee-4a95-8eb5-1392e4e3ee51 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:05.843055 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-42bedf66-c4ee-4a95-8eb5-1392e4e3ee51 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:05.843895 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-42bedf66-c4ee-4a95-8eb5-1392e4e3ee51 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:06.062108 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-42bedf66-c4ee-4a95-8eb5-1392e4e3ee51 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:06.074304 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-42bedf66-c4ee-4a95-8eb5-1392e4e3ee51 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:06.079201 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-42bedf66-c4ee-4a95-8eb5-1392e4e3ee51 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:06.082699 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-42bedf66-c4ee-4a95-8eb5-1392e4e3ee51 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1738 microversion: 2.20 time: 0.258221 Aug 09 11:20:06.083141 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-57d2baaf-a4af-4f6f-94ed-e34d8bfbd036 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:06.084171 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 140/309] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:20:05 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1738 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:20:06.097145 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-57d2baaf-a4af-4f6f-94ed-e34d8bfbd036 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:06.099559 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_api:SELECT=100 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:06.109961 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-57d2baaf-a4af-4f6f-94ed-e34d8bfbd036 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:06.111423 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-57d2baaf-a4af-4f6f-94ed-e34d8bfbd036 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:06.112199 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-57d2baaf-a4af-4f6f-94ed-e34d8bfbd036 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:06.113379 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-57d2baaf-a4af-4f6f-94ed-e34d8bfbd036 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:06.114147 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-57d2baaf-a4af-4f6f-94ed-e34d8bfbd036 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:06.114965 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-57d2baaf-a4af-4f6f-94ed-e34d8bfbd036 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:06.327536 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-4dbc45d7-a97f-49dd-b2d5-03607fd13c7c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:06.328156 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-4dbc45d7-a97f-49dd-b2d5-03607fd13c7c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:06.335567 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4dbc45d7-a97f-49dd-b2d5-03607fd13c7c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:06.336060 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4dbc45d7-a97f-49dd-b2d5-03607fd13c7c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:06.336534 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4dbc45d7-a97f-49dd-b2d5-03607fd13c7c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:06.337272 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4dbc45d7-a97f-49dd-b2d5-03607fd13c7c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:06.337725 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4dbc45d7-a97f-49dd-b2d5-03607fd13c7c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:06.338142 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4dbc45d7-a97f-49dd-b2d5-03607fd13c7c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:06.371675 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-57d2baaf-a4af-4f6f-94ed-e34d8bfbd036 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:06.383308 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-57d2baaf-a4af-4f6f-94ed-e34d8bfbd036 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1723 microversion: 2.1 time: 0.304740 Aug 09 11:20:06.385875 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 170/310] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:06 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1723 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:20:06.455790 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-4bea7178-0577-4c0b-bac8-5cc6185e81bb tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:06.456454 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-4bea7178-0577-4c0b-bac8-5cc6185e81bb tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: eee55879-1bf3-41e4-b439-0c903100e828] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:06.472701 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4bea7178-0577-4c0b-bac8-5cc6185e81bb tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:06.474130 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4bea7178-0577-4c0b-bac8-5cc6185e81bb tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:06.474577 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4bea7178-0577-4c0b-bac8-5cc6185e81bb tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:06.475340 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4bea7178-0577-4c0b-bac8-5cc6185e81bb tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:06.478494 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4bea7178-0577-4c0b-bac8-5cc6185e81bb tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:06.479028 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4bea7178-0577-4c0b-bac8-5cc6185e81bb tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:06.701032 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-4bea7178-0577-4c0b-bac8-5cc6185e81bb tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:06.707032 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-4dbc45d7-a97f-49dd-b2d5-03607fd13c7c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:06.712439 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-4bea7178-0577-4c0b-bac8-5cc6185e81bb tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828" status: 200 len: 1300 microversion: 2.1 time: 0.260664 Aug 09 11:20:06.713426 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 171/311] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:06 2022] GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828 => generated 1300 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:06.723849 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-4dbc45d7-a97f-49dd-b2d5-03607fd13c7c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697" status: 200 len: 1521 microversion: 2.1 time: 0.400116 Aug 09 11:20:06.739624 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 141/312] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:06 2022] GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697 => generated 1521 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:07.111289 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-139b1dad-d3f0-455a-8dc6-4b6abdab76b0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:07.112032 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-139b1dad-d3f0-455a-8dc6-4b6abdab76b0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:07.138447 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-139b1dad-d3f0-455a-8dc6-4b6abdab76b0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:07.138837 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-139b1dad-d3f0-455a-8dc6-4b6abdab76b0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:07.139267 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-139b1dad-d3f0-455a-8dc6-4b6abdab76b0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:07.140108 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-139b1dad-d3f0-455a-8dc6-4b6abdab76b0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:07.140522 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-139b1dad-d3f0-455a-8dc6-4b6abdab76b0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:07.140903 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-139b1dad-d3f0-455a-8dc6-4b6abdab76b0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:07.336468 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-139b1dad-d3f0-455a-8dc6-4b6abdab76b0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:07.345480 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-139b1dad-d3f0-455a-8dc6-4b6abdab76b0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:07.347027 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-139b1dad-d3f0-455a-8dc6-4b6abdab76b0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:07.359383 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-139b1dad-d3f0-455a-8dc6-4b6abdab76b0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1738 microversion: 2.20 time: 0.251905 Aug 09 11:20:07.361378 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 172/313] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:20:07 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1738 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:20:07.407583 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-7e59ad0f-7cfe-4c1e-8a00-161006b2218d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:07.408322 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-7e59ad0f-7cfe-4c1e-8a00-161006b2218d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:07.421045 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7e59ad0f-7cfe-4c1e-8a00-161006b2218d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:07.421742 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7e59ad0f-7cfe-4c1e-8a00-161006b2218d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:07.422273 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7e59ad0f-7cfe-4c1e-8a00-161006b2218d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:07.425444 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7e59ad0f-7cfe-4c1e-8a00-161006b2218d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:07.426008 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7e59ad0f-7cfe-4c1e-8a00-161006b2218d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:07.428912 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7e59ad0f-7cfe-4c1e-8a00-161006b2218d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:07.708155 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-7e59ad0f-7cfe-4c1e-8a00-161006b2218d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:07.718099 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-7e59ad0f-7cfe-4c1e-8a00-161006b2218d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1723 microversion: 2.1 time: 0.315160 Aug 09 11:20:07.719446 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 142/314] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:07 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1723 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:07.739922 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-faeb0f7a-ebde-4606-beff-2339c9372f58 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:07.741272 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-faeb0f7a-ebde-4606-beff-2339c9372f58 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: eee55879-1bf3-41e4-b439-0c903100e828] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:07.752803 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-faeb0f7a-ebde-4606-beff-2339c9372f58 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:07.753055 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-17377131-853b-46d0-807d-25da332f4a5e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:07.753698 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-faeb0f7a-ebde-4606-beff-2339c9372f58 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:07.754457 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-faeb0f7a-ebde-4606-beff-2339c9372f58 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:07.755113 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-17377131-853b-46d0-807d-25da332f4a5e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:07.755515 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-faeb0f7a-ebde-4606-beff-2339c9372f58 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:07.756230 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-faeb0f7a-ebde-4606-beff-2339c9372f58 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:07.756957 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-faeb0f7a-ebde-4606-beff-2339c9372f58 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:07.768289 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-17377131-853b-46d0-807d-25da332f4a5e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:07.768706 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-17377131-853b-46d0-807d-25da332f4a5e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:07.769144 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-17377131-853b-46d0-807d-25da332f4a5e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:07.770024 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-17377131-853b-46d0-807d-25da332f4a5e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:07.770544 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-17377131-853b-46d0-807d-25da332f4a5e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:07.770977 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-17377131-853b-46d0-807d-25da332f4a5e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:07.999997 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-faeb0f7a-ebde-4606-beff-2339c9372f58 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:08.012377 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-faeb0f7a-ebde-4606-beff-2339c9372f58 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828" status: 200 len: 1367 microversion: 2.1 time: 0.272318 Aug 09 11:20:08.013354 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 173/315] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:07 2022] GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828 => generated 1367 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:20:08.048258 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-17377131-853b-46d0-807d-25da332f4a5e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:08.059084 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-17377131-853b-46d0-807d-25da332f4a5e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697" status: 200 len: 1521 microversion: 2.1 time: 0.313176 Aug 09 11:20:08.060007 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 143/316] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:07 2022] GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697 => generated 1521 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:08.394677 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-32c1bf90-2738-4278-98b2-d25254540e1b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:08.395690 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [req-2eacc1b7-684e-45c7-a262-f481e8734dd5 req-849f6244-0cba-4cf3-bf8e-6be7b4123220 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eee55879-1bf3-41e4-b439-0c903100e828", "tag": "e6897a01-7b9e-4865-b51f-2d3190ae1e3a"}]} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:20:08.400592 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-32c1bf90-2738-4278-98b2-d25254540e1b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:08.434403 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-32c1bf90-2738-4278-98b2-d25254540e1b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:08.437267 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-32c1bf90-2738-4278-98b2-d25254540e1b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:08.438600 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-32c1bf90-2738-4278-98b2-d25254540e1b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:08.441504 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-32c1bf90-2738-4278-98b2-d25254540e1b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:08.442667 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-32c1bf90-2738-4278-98b2-d25254540e1b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:08.445440 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-32c1bf90-2738-4278-98b2-d25254540e1b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:08.452902 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-2eacc1b7-684e-45c7-a262-f481e8734dd5 req-849f6244-0cba-4cf3-bf8e-6be7b4123220 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:08.456332 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-2eacc1b7-684e-45c7-a262-f481e8734dd5 req-849f6244-0cba-4cf3-bf8e-6be7b4123220 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:08.458071 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-2eacc1b7-684e-45c7-a262-f481e8734dd5 req-849f6244-0cba-4cf3-bf8e-6be7b4123220 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:08.486032 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.compute.server_external_events [req-2eacc1b7-684e-45c7-a262-f481e8734dd5 req-849f6244-0cba-4cf3-bf8e-6be7b4123220 service nova] Creating event network-changed:e6897a01-7b9e-4865-b51f-2d3190ae1e3a for instance eee55879-1bf3-41e4-b439-0c903100e828 on hv-cinder-85251 Aug 09 11:20:08.496375 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [req-2eacc1b7-684e-45c7-a262-f481e8734dd5 req-849f6244-0cba-4cf3-bf8e-6be7b4123220 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112967 Aug 09 11:20:08.500306 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 144/317] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:20:08.750476 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-fb8136cc-b7b4-4d23-aec5-dc43b8d44a43 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:08.751636 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-fb8136cc-b7b4-4d23-aec5-dc43b8d44a43 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:08.760016 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-fb8136cc-b7b4-4d23-aec5-dc43b8d44a43 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:08.760981 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-fb8136cc-b7b4-4d23-aec5-dc43b8d44a43 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:08.761649 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-fb8136cc-b7b4-4d23-aec5-dc43b8d44a43 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:08.762580 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-fb8136cc-b7b4-4d23-aec5-dc43b8d44a43 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:08.763563 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-fb8136cc-b7b4-4d23-aec5-dc43b8d44a43 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:08.764191 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-fb8136cc-b7b4-4d23-aec5-dc43b8d44a43 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:08.901694 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-32c1bf90-2738-4278-98b2-d25254540e1b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:08.928322 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-32c1bf90-2738-4278-98b2-d25254540e1b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:08.932207 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-32c1bf90-2738-4278-98b2-d25254540e1b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:08.933726 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-32c1bf90-2738-4278-98b2-d25254540e1b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1738 microversion: 2.20 time: 0.551573 Aug 09 11:20:08.934804 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 174/318] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:20:08 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1738 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:20:09.039524 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-5b3fe076-f251-4b45-8d3f-6b9e68cab63b tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:09.040344 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-5b3fe076-f251-4b45-8d3f-6b9e68cab63b tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: eee55879-1bf3-41e4-b439-0c903100e828] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:09.049540 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5b3fe076-f251-4b45-8d3f-6b9e68cab63b tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:09.052630 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5b3fe076-f251-4b45-8d3f-6b9e68cab63b tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:09.053535 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5b3fe076-f251-4b45-8d3f-6b9e68cab63b tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:09.054902 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5b3fe076-f251-4b45-8d3f-6b9e68cab63b tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:09.060720 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5b3fe076-f251-4b45-8d3f-6b9e68cab63b tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:09.063589 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5b3fe076-f251-4b45-8d3f-6b9e68cab63b tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:09.218999 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-fb8136cc-b7b4-4d23-aec5-dc43b8d44a43 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:09.229820 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-fb8136cc-b7b4-4d23-aec5-dc43b8d44a43 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1700 microversion: 2.1 time: 0.484318 Aug 09 11:20:09.231378 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 145/319] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:08 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1700 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:09.237362 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-24f09a48-4961-4743-8ac7-477da09cae96 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:09.238336 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-24f09a48-4961-4743-8ac7-477da09cae96 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:09.247978 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-24f09a48-4961-4743-8ac7-477da09cae96 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:09.249638 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-24f09a48-4961-4743-8ac7-477da09cae96 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:09.253695 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-24f09a48-4961-4743-8ac7-477da09cae96 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:09.254913 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-24f09a48-4961-4743-8ac7-477da09cae96 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:09.255583 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-24f09a48-4961-4743-8ac7-477da09cae96 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:09.256156 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-24f09a48-4961-4743-8ac7-477da09cae96 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:09.477387 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-5b3fe076-f251-4b45-8d3f-6b9e68cab63b tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:09.485440 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-5b3fe076-f251-4b45-8d3f-6b9e68cab63b tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828" status: 200 len: 1367 microversion: 2.1 time: 0.449706 Aug 09 11:20:09.492820 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 175/320] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:09 2022] GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828 => generated 1367 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:20:09.506335 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-ff64ad9d-7649-4e1f-a098-2274c01b9bde tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:20:09.515224 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ff64ad9d-7649-4e1f-a098-2274c01b9bde tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:09.516006 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ff64ad9d-7649-4e1f-a098-2274c01b9bde tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:09.516809 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ff64ad9d-7649-4e1f-a098-2274c01b9bde tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:09.562175 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-ff64ad9d-7649-4e1f-a098-2274c01b9bde tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Going to try to start instance {{(pid=117685) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 09 11:20:09.579950 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-24f09a48-4961-4743-8ac7-477da09cae96 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:09.601889 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-24f09a48-4961-4743-8ac7-477da09cae96 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697" status: 200 len: 1521 microversion: 2.1 time: 0.368613 Aug 09 11:20:09.607933 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 146/321] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:09 2022] GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697 => generated 1521 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:09.660922 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-ff64ad9d-7649-4e1f-a098-2274c01b9bde tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "POST /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f/action" status: 202 len: 0 microversion: 2.1 time: 0.166121 Aug 09 11:20:09.663265 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 176/322] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 9 11:20:09 2022] POST /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:20:09.680772 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-bd9abfed-51ad-468e-a853-a61346423a82 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:09.686018 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-bd9abfed-51ad-468e-a853-a61346423a82 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:09.702771 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-bd9abfed-51ad-468e-a853-a61346423a82 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:09.704084 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-bd9abfed-51ad-468e-a853-a61346423a82 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:09.704917 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-bd9abfed-51ad-468e-a853-a61346423a82 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:09.706215 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-bd9abfed-51ad-468e-a853-a61346423a82 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:09.707053 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-bd9abfed-51ad-468e-a853-a61346423a82 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:09.724448 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-bd9abfed-51ad-468e-a853-a61346423a82 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:09.912331 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-bd9abfed-51ad-468e-a853-a61346423a82 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:09.922802 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-bd9abfed-51ad-468e-a853-a61346423a82 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1709 microversion: 2.1 time: 0.254217 Aug 09 11:20:09.925703 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 147/323] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:09 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1709 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:09.957421 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-31b8f8c1-58e1-4a1e-a747-81d5bec1c108 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:09.959016 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-31b8f8c1-58e1-4a1e-a747-81d5bec1c108 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:09.967141 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-31b8f8c1-58e1-4a1e-a747-81d5bec1c108 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:09.967891 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-31b8f8c1-58e1-4a1e-a747-81d5bec1c108 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:09.968531 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-31b8f8c1-58e1-4a1e-a747-81d5bec1c108 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:09.969425 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-31b8f8c1-58e1-4a1e-a747-81d5bec1c108 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:09.970021 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-31b8f8c1-58e1-4a1e-a747-81d5bec1c108 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:09.970586 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-31b8f8c1-58e1-4a1e-a747-81d5bec1c108 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:10.185065 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-31b8f8c1-58e1-4a1e-a747-81d5bec1c108 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:10.189444 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:10.197297 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-31b8f8c1-58e1-4a1e-a747-81d5bec1c108 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:10.203433 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-31b8f8c1-58e1-4a1e-a747-81d5bec1c108 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:10.205315 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-31b8f8c1-58e1-4a1e-a747-81d5bec1c108 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1738 microversion: 2.20 time: 0.252359 Aug 09 11:20:10.207702 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 177/324] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:20:09 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1738 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:20:10.515007 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-eb091172-af7a-410c-a18e-1257bf24b918 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:10.515898 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-eb091172-af7a-410c-a18e-1257bf24b918 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: eee55879-1bf3-41e4-b439-0c903100e828] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:10.526974 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-eb091172-af7a-410c-a18e-1257bf24b918 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:10.527725 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-eb091172-af7a-410c-a18e-1257bf24b918 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:10.528448 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-eb091172-af7a-410c-a18e-1257bf24b918 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:10.529386 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-eb091172-af7a-410c-a18e-1257bf24b918 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:10.532203 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-eb091172-af7a-410c-a18e-1257bf24b918 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:10.532991 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-eb091172-af7a-410c-a18e-1257bf24b918 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:10.651643 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-3122620e-43a0-4ea3-abe2-a157f12f0ccc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:10.655362 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-3122620e-43a0-4ea3-abe2-a157f12f0ccc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:10.672688 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3122620e-43a0-4ea3-abe2-a157f12f0ccc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:10.675587 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3122620e-43a0-4ea3-abe2-a157f12f0ccc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:10.676124 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3122620e-43a0-4ea3-abe2-a157f12f0ccc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:10.676912 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3122620e-43a0-4ea3-abe2-a157f12f0ccc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:10.679873 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3122620e-43a0-4ea3-abe2-a157f12f0ccc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:10.680450 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3122620e-43a0-4ea3-abe2-a157f12f0ccc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:10.841008 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-eb091172-af7a-410c-a18e-1257bf24b918 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:10.851859 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-eb091172-af7a-410c-a18e-1257bf24b918 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828" status: 200 len: 1367 microversion: 2.1 time: 0.341074 Aug 09 11:20:10.870178 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 148/325] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:10 2022] GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828 => generated 1367 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:10.946400 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-f3d14a7e-ce65-4024-8c75-9f6a1cf25492 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:10.947331 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-f3d14a7e-ce65-4024-8c75-9f6a1cf25492 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:10.958381 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f3d14a7e-ce65-4024-8c75-9f6a1cf25492 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:10.958902 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f3d14a7e-ce65-4024-8c75-9f6a1cf25492 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:10.962251 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f3d14a7e-ce65-4024-8c75-9f6a1cf25492 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:10.963025 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f3d14a7e-ce65-4024-8c75-9f6a1cf25492 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:10.963500 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f3d14a7e-ce65-4024-8c75-9f6a1cf25492 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:10.967359 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f3d14a7e-ce65-4024-8c75-9f6a1cf25492 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:11.018677 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-3122620e-43a0-4ea3-abe2-a157f12f0ccc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:11.027480 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-3122620e-43a0-4ea3-abe2-a157f12f0ccc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697" status: 200 len: 1521 microversion: 2.1 time: 0.399658 Aug 09 11:20:11.028664 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 178/326] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:10 2022] GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697 => generated 1521 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:11.182422 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-f3d14a7e-ce65-4024-8c75-9f6a1cf25492 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:11.195829 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-f3d14a7e-ce65-4024-8c75-9f6a1cf25492 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1709 microversion: 2.1 time: 0.255419 Aug 09 11:20:11.211467 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 149/327] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:10 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1709 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:11.237088 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-2746b7b0-c656-4eb1-8fb4-17ddecd594a9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:11.237314 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-2746b7b0-c656-4eb1-8fb4-17ddecd594a9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:11.244368 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2746b7b0-c656-4eb1-8fb4-17ddecd594a9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:11.244754 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2746b7b0-c656-4eb1-8fb4-17ddecd594a9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:11.246453 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2746b7b0-c656-4eb1-8fb4-17ddecd594a9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:11.247584 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2746b7b0-c656-4eb1-8fb4-17ddecd594a9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:11.250825 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2746b7b0-c656-4eb1-8fb4-17ddecd594a9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:11.251466 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2746b7b0-c656-4eb1-8fb4-17ddecd594a9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:11.474449 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-2746b7b0-c656-4eb1-8fb4-17ddecd594a9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:11.489037 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-2746b7b0-c656-4eb1-8fb4-17ddecd594a9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:11.490641 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-2746b7b0-c656-4eb1-8fb4-17ddecd594a9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:11.491944 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-2746b7b0-c656-4eb1-8fb4-17ddecd594a9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1738 microversion: 2.20 time: 0.260124 Aug 09 11:20:11.494223 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 179/328] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:20:11 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1738 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:20:11.887834 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-f526db83-83f8-4971-b3cd-70d961d887bf tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:11.889091 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-f526db83-83f8-4971-b3cd-70d961d887bf tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: eee55879-1bf3-41e4-b439-0c903100e828] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:11.897815 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f526db83-83f8-4971-b3cd-70d961d887bf tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:11.898887 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f526db83-83f8-4971-b3cd-70d961d887bf tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:11.899646 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f526db83-83f8-4971-b3cd-70d961d887bf tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:11.900823 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f526db83-83f8-4971-b3cd-70d961d887bf tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:11.901520 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f526db83-83f8-4971-b3cd-70d961d887bf tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:11.902155 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f526db83-83f8-4971-b3cd-70d961d887bf tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:12.052955 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-a1767545-cb44-4597-985a-de384b0f203a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:12.054196 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-a1767545-cb44-4597-985a-de384b0f203a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:12.063332 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-f526db83-83f8-4971-b3cd-70d961d887bf tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:12.065926 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a1767545-cb44-4597-985a-de384b0f203a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:12.066417 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a1767545-cb44-4597-985a-de384b0f203a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:12.067040 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a1767545-cb44-4597-985a-de384b0f203a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:12.067751 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a1767545-cb44-4597-985a-de384b0f203a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:12.068200 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a1767545-cb44-4597-985a-de384b0f203a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:12.068775 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a1767545-cb44-4597-985a-de384b0f203a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:12.070978 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-f526db83-83f8-4971-b3cd-70d961d887bf tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828" status: 200 len: 1367 microversion: 2.1 time: 0.187703 Aug 09 11:20:12.080507 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 150/329] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:11 2022] GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828 => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:12.220644 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-11d358b7-e1c2-48b6-a696-90857bdc286e tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:12.221554 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-11d358b7-e1c2-48b6-a696-90857bdc286e tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:12.227877 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-11d358b7-e1c2-48b6-a696-90857bdc286e tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:12.228655 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-11d358b7-e1c2-48b6-a696-90857bdc286e tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:12.229259 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-11d358b7-e1c2-48b6-a696-90857bdc286e tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:12.230127 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-11d358b7-e1c2-48b6-a696-90857bdc286e tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:12.230732 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-11d358b7-e1c2-48b6-a696-90857bdc286e tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:12.231311 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-11d358b7-e1c2-48b6-a696-90857bdc286e tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:12.236668 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-a1767545-cb44-4597-985a-de384b0f203a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:12.246554 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-a1767545-cb44-4597-985a-de384b0f203a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697" status: 200 len: 1521 microversion: 2.1 time: 0.197452 Aug 09 11:20:12.256562 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 180/330] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:12 2022] GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:20:12.404664 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-11d358b7-e1c2-48b6-a696-90857bdc286e tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:12.427581 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-11d358b7-e1c2-48b6-a696-90857bdc286e tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1709 microversion: 2.1 time: 0.213061 Aug 09 11:20:12.428675 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 151/331] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:12 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1709 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:12.516728 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-d10ae2a0-1ca9-4f4b-96e0-300a4fa08c90 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:12.517404 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-d10ae2a0-1ca9-4f4b-96e0-300a4fa08c90 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:12.524961 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d10ae2a0-1ca9-4f4b-96e0-300a4fa08c90 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:12.526088 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d10ae2a0-1ca9-4f4b-96e0-300a4fa08c90 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:12.530932 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d10ae2a0-1ca9-4f4b-96e0-300a4fa08c90 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:12.531880 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d10ae2a0-1ca9-4f4b-96e0-300a4fa08c90 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:12.532528 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d10ae2a0-1ca9-4f4b-96e0-300a4fa08c90 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:12.533117 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d10ae2a0-1ca9-4f4b-96e0-300a4fa08c90 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:12.716476 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-d10ae2a0-1ca9-4f4b-96e0-300a4fa08c90 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:12.725720 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-d10ae2a0-1ca9-4f4b-96e0-300a4fa08c90 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:12.727291 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-d10ae2a0-1ca9-4f4b-96e0-300a4fa08c90 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:12.728726 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-d10ae2a0-1ca9-4f4b-96e0-300a4fa08c90 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1738 microversion: 2.20 time: 0.216634 Aug 09 11:20:12.744992 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 181/332] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:20:12 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1738 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 11:20:13.096594 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-64963c9d-e65b-4e35-abda-5e03c8a836a0 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:13.097366 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-64963c9d-e65b-4e35-abda-5e03c8a836a0 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: eee55879-1bf3-41e4-b439-0c903100e828] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:13.110377 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-64963c9d-e65b-4e35-abda-5e03c8a836a0 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:13.116187 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-64963c9d-e65b-4e35-abda-5e03c8a836a0 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:13.116187 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-64963c9d-e65b-4e35-abda-5e03c8a836a0 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:13.116187 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-64963c9d-e65b-4e35-abda-5e03c8a836a0 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:13.116187 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-64963c9d-e65b-4e35-abda-5e03c8a836a0 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:13.116810 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-64963c9d-e65b-4e35-abda-5e03c8a836a0 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:13.268737 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-10b73efb-6026-4a67-95f7-0462f01998aa tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:13.269980 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-10b73efb-6026-4a67-95f7-0462f01998aa tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:13.279592 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-10b73efb-6026-4a67-95f7-0462f01998aa tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:13.280409 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-10b73efb-6026-4a67-95f7-0462f01998aa tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:13.281034 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-10b73efb-6026-4a67-95f7-0462f01998aa tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:13.281931 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-10b73efb-6026-4a67-95f7-0462f01998aa tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:13.282552 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-10b73efb-6026-4a67-95f7-0462f01998aa tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:13.282987 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-10b73efb-6026-4a67-95f7-0462f01998aa tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:13.290206 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-64963c9d-e65b-4e35-abda-5e03c8a836a0 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:13.299244 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-64963c9d-e65b-4e35-abda-5e03c8a836a0 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828" status: 200 len: 1367 microversion: 2.1 time: 0.207817 Aug 09 11:20:13.304528 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 152/333] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:13 2022] GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828 => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:13.443839 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-10b73efb-6026-4a67-95f7-0462f01998aa tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:13.451167 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-b1b096f2-ab9d-4708-924e-9110bbfe460f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:13.451767 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-b1b096f2-ab9d-4708-924e-9110bbfe460f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:13.456013 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-10b73efb-6026-4a67-95f7-0462f01998aa tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697" status: 200 len: 1521 microversion: 2.1 time: 0.191105 Aug 09 11:20:13.456804 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 182/334] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:13 2022] GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:20:13.470289 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b1b096f2-ab9d-4708-924e-9110bbfe460f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:13.470795 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b1b096f2-ab9d-4708-924e-9110bbfe460f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:13.471231 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b1b096f2-ab9d-4708-924e-9110bbfe460f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:13.471959 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b1b096f2-ab9d-4708-924e-9110bbfe460f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:13.472436 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b1b096f2-ab9d-4708-924e-9110bbfe460f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:13.472855 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b1b096f2-ab9d-4708-924e-9110bbfe460f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:13.627143 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-b1b096f2-ab9d-4708-924e-9110bbfe460f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:13.637317 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-b1b096f2-ab9d-4708-924e-9110bbfe460f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1713 microversion: 2.1 time: 0.190060 Aug 09 11:20:13.638214 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 153/335] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:13 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1713 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:13.755264 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-9f0d83dc-3f6a-4969-8dc8-f79ee0f7cbd3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:13.755871 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-9f0d83dc-3f6a-4969-8dc8-f79ee0f7cbd3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:13.762300 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9f0d83dc-3f6a-4969-8dc8-f79ee0f7cbd3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:13.763106 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9f0d83dc-3f6a-4969-8dc8-f79ee0f7cbd3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:13.764032 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9f0d83dc-3f6a-4969-8dc8-f79ee0f7cbd3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:13.764924 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9f0d83dc-3f6a-4969-8dc8-f79ee0f7cbd3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:13.765523 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9f0d83dc-3f6a-4969-8dc8-f79ee0f7cbd3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:13.766094 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9f0d83dc-3f6a-4969-8dc8-f79ee0f7cbd3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:13.913749 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-9f0d83dc-3f6a-4969-8dc8-f79ee0f7cbd3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:13.922266 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-9f0d83dc-3f6a-4969-8dc8-f79ee0f7cbd3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:13.925191 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-9f0d83dc-3f6a-4969-8dc8-f79ee0f7cbd3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:13.926587 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-9f0d83dc-3f6a-4969-8dc8-f79ee0f7cbd3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1738 microversion: 2.20 time: 0.175276 Aug 09 11:20:13.927476 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 183/336] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:20:13 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:20:14.321309 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-d9b3fc58-897a-4cd6-9035-e8cce126e7d0 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:14.322627 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-d9b3fc58-897a-4cd6-9035-e8cce126e7d0 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: eee55879-1bf3-41e4-b439-0c903100e828] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:14.333787 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell0:SELECT=2 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:14.335076 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell0:SELECT=6 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:14.341526 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d9b3fc58-897a-4cd6-9035-e8cce126e7d0 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:14.342028 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d9b3fc58-897a-4cd6-9035-e8cce126e7d0 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:14.342454 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d9b3fc58-897a-4cd6-9035-e8cce126e7d0 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:14.343471 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d9b3fc58-897a-4cd6-9035-e8cce126e7d0 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:14.343886 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d9b3fc58-897a-4cd6-9035-e8cce126e7d0 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:14.344309 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d9b3fc58-897a-4cd6-9035-e8cce126e7d0 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:14.476602 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-552bd28c-074c-4704-a195-671b70ed1729 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:14.477848 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-552bd28c-074c-4704-a195-671b70ed1729 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:14.490979 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell0:SELECT=2 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:14.493348 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-552bd28c-074c-4704-a195-671b70ed1729 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:14.494148 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-552bd28c-074c-4704-a195-671b70ed1729 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:14.495137 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-552bd28c-074c-4704-a195-671b70ed1729 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:14.496044 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-552bd28c-074c-4704-a195-671b70ed1729 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:14.496676 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-552bd28c-074c-4704-a195-671b70ed1729 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:14.497261 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-552bd28c-074c-4704-a195-671b70ed1729 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:14.513822 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-d9b3fc58-897a-4cd6-9035-e8cce126e7d0 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:14.517649 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell1:SELECT=100 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:14.524169 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-d9b3fc58-897a-4cd6-9035-e8cce126e7d0 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828" status: 200 len: 1367 microversion: 2.1 time: 0.206903 Aug 09 11:20:14.525501 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 154/337] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:14 2022] GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828 => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:14.562224 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [req-89b43506-0ae8-4d0f-959f-9322fc7c646a req-abe5fe08-b158-44c3-bc46-865d6b297137 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eee55879-1bf3-41e4-b439-0c903100e828", "name": "network-vif-plugged", "status": "completed", "tag": "e6897a01-7b9e-4865-b51f-2d3190ae1e3a"}]} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:20:14.587802 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-89b43506-0ae8-4d0f-959f-9322fc7c646a req-abe5fe08-b158-44c3-bc46-865d6b297137 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:14.588293 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-89b43506-0ae8-4d0f-959f-9322fc7c646a req-abe5fe08-b158-44c3-bc46-865d6b297137 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:14.588803 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-89b43506-0ae8-4d0f-959f-9322fc7c646a req-abe5fe08-b158-44c3-bc46-865d6b297137 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:14.612090 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.compute.server_external_events [req-89b43506-0ae8-4d0f-959f-9322fc7c646a req-abe5fe08-b158-44c3-bc46-865d6b297137 service nova] Creating event network-vif-plugged:e6897a01-7b9e-4865-b51f-2d3190ae1e3a for instance eee55879-1bf3-41e4-b439-0c903100e828 on hv-cinder-85251 Aug 09 11:20:14.622274 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [req-89b43506-0ae8-4d0f-959f-9322fc7c646a req-abe5fe08-b158-44c3-bc46-865d6b297137 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067813 Aug 09 11:20:14.622855 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 155/338] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:20:14.723752 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-552bd28c-074c-4704-a195-671b70ed1729 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:14.733709 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-552bd28c-074c-4704-a195-671b70ed1729 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697" status: 200 len: 1521 microversion: 2.1 time: 0.260930 Aug 09 11:20:14.748139 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 184/339] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:14 2022] GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697 => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:14.951526 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-d6ca5ea4-6102-457d-9066-5771ab6e57c4 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:14.952209 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-d6ca5ea4-6102-457d-9066-5771ab6e57c4 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:14.959091 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d6ca5ea4-6102-457d-9066-5771ab6e57c4 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:14.959567 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d6ca5ea4-6102-457d-9066-5771ab6e57c4 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:14.959995 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d6ca5ea4-6102-457d-9066-5771ab6e57c4 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:14.960725 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d6ca5ea4-6102-457d-9066-5771ab6e57c4 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:14.961164 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d6ca5ea4-6102-457d-9066-5771ab6e57c4 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:14.961568 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d6ca5ea4-6102-457d-9066-5771ab6e57c4 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:15.126236 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-d6ca5ea4-6102-457d-9066-5771ab6e57c4 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:15.140765 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-d6ca5ea4-6102-457d-9066-5771ab6e57c4 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:15.142269 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-d6ca5ea4-6102-457d-9066-5771ab6e57c4 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:15.144133 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-d6ca5ea4-6102-457d-9066-5771ab6e57c4 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1738 microversion: 2.20 time: 0.196643 Aug 09 11:20:15.144308 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 156/340] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:20:14 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1738 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:20:15.545652 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-b2af5690-8b26-4127-ae7c-f3d2abc662a4 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:15.546220 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-b2af5690-8b26-4127-ae7c-f3d2abc662a4 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: eee55879-1bf3-41e4-b439-0c903100e828] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:15.553266 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b2af5690-8b26-4127-ae7c-f3d2abc662a4 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:15.553706 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b2af5690-8b26-4127-ae7c-f3d2abc662a4 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:15.554135 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b2af5690-8b26-4127-ae7c-f3d2abc662a4 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:15.554790 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b2af5690-8b26-4127-ae7c-f3d2abc662a4 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:15.555248 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b2af5690-8b26-4127-ae7c-f3d2abc662a4 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:15.555667 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b2af5690-8b26-4127-ae7c-f3d2abc662a4 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:15.692980 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-b2af5690-8b26-4127-ae7c-f3d2abc662a4 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:15.701844 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-b2af5690-8b26-4127-ae7c-f3d2abc662a4 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828" status: 200 len: 1367 microversion: 2.1 time: 0.160120 Aug 09 11:20:15.702498 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 185/341] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:15 2022] GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:15.756933 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-81f07b8b-1c67-431f-99f6-cb08f8fb9ceb tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:15.757690 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-81f07b8b-1c67-431f-99f6-cb08f8fb9ceb tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:15.765275 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-81f07b8b-1c67-431f-99f6-cb08f8fb9ceb tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:15.765756 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-81f07b8b-1c67-431f-99f6-cb08f8fb9ceb tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:15.766371 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-81f07b8b-1c67-431f-99f6-cb08f8fb9ceb tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:15.767069 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-81f07b8b-1c67-431f-99f6-cb08f8fb9ceb tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:15.767537 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-81f07b8b-1c67-431f-99f6-cb08f8fb9ceb tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:15.767957 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-81f07b8b-1c67-431f-99f6-cb08f8fb9ceb tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:15.921223 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-81f07b8b-1c67-431f-99f6-cb08f8fb9ceb tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:15.929219 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-81f07b8b-1c67-431f-99f6-cb08f8fb9ceb tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697" status: 200 len: 1521 microversion: 2.1 time: 0.177992 Aug 09 11:20:15.929748 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 157/342] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:15 2022] GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:16.172187 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-1b0ac659-b516-4d8e-afd0-d7c2b30efee0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:16.173579 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-1b0ac659-b516-4d8e-afd0-d7c2b30efee0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:16.185567 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1b0ac659-b516-4d8e-afd0-d7c2b30efee0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:16.186066 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1b0ac659-b516-4d8e-afd0-d7c2b30efee0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:16.186755 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1b0ac659-b516-4d8e-afd0-d7c2b30efee0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:16.187642 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1b0ac659-b516-4d8e-afd0-d7c2b30efee0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:16.188517 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1b0ac659-b516-4d8e-afd0-d7c2b30efee0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:16.188943 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1b0ac659-b516-4d8e-afd0-d7c2b30efee0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:16.335512 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-1b0ac659-b516-4d8e-afd0-d7c2b30efee0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:16.344394 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-1b0ac659-b516-4d8e-afd0-d7c2b30efee0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:16.345934 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-1b0ac659-b516-4d8e-afd0-d7c2b30efee0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:16.347135 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-1b0ac659-b516-4d8e-afd0-d7c2b30efee0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1738 microversion: 2.20 time: 0.179911 Aug 09 11:20:16.347758 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 186/343] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:20:16 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:20:16.726727 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-d8f6eaf2-418a-4bfc-8cb1-6edb6413040e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:16.727429 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-d8f6eaf2-418a-4bfc-8cb1-6edb6413040e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: eee55879-1bf3-41e4-b439-0c903100e828] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:16.734706 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d8f6eaf2-418a-4bfc-8cb1-6edb6413040e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:16.735188 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d8f6eaf2-418a-4bfc-8cb1-6edb6413040e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:16.735621 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d8f6eaf2-418a-4bfc-8cb1-6edb6413040e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:16.736298 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d8f6eaf2-418a-4bfc-8cb1-6edb6413040e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:16.736785 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d8f6eaf2-418a-4bfc-8cb1-6edb6413040e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:16.737202 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d8f6eaf2-418a-4bfc-8cb1-6edb6413040e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:16.881939 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-d8f6eaf2-418a-4bfc-8cb1-6edb6413040e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:16.891750 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-d8f6eaf2-418a-4bfc-8cb1-6edb6413040e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828" status: 200 len: 1557 microversion: 2.1 time: 0.171331 Aug 09 11:20:16.892576 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 158/344] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:16 2022] GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828 => generated 1557 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:16.917580 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-3710b112-ca76-44f2-9515-3585f354b1a3 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:16.918213 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-3710b112-ca76-44f2-9515-3585f354b1a3 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: eee55879-1bf3-41e4-b439-0c903100e828] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:16.927412 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3710b112-ca76-44f2-9515-3585f354b1a3 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:16.927892 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3710b112-ca76-44f2-9515-3585f354b1a3 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:16.928346 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3710b112-ca76-44f2-9515-3585f354b1a3 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:16.929043 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3710b112-ca76-44f2-9515-3585f354b1a3 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:16.929482 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3710b112-ca76-44f2-9515-3585f354b1a3 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:16.929893 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3710b112-ca76-44f2-9515-3585f354b1a3 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:16.951904 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-a2cd10e2-7673-472b-9d8e-b900024d4f3b tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:16.952679 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-a2cd10e2-7673-472b-9d8e-b900024d4f3b tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:16.958763 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a2cd10e2-7673-472b-9d8e-b900024d4f3b tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:16.959253 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a2cd10e2-7673-472b-9d8e-b900024d4f3b tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:16.959686 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a2cd10e2-7673-472b-9d8e-b900024d4f3b tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:16.960409 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a2cd10e2-7673-472b-9d8e-b900024d4f3b tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:16.960867 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a2cd10e2-7673-472b-9d8e-b900024d4f3b tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:16.961290 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a2cd10e2-7673-472b-9d8e-b900024d4f3b tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:17.039100 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-3710b112-ca76-44f2-9515-3585f354b1a3 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.128359 Aug 09 11:20:17.039679 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 187/345] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Aug 9 11:20:16 2022] GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828/os-interface => generated 284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:20:17.119038 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-a2cd10e2-7673-472b-9d8e-b900024d4f3b tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:17.126918 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-a2cd10e2-7673-472b-9d8e-b900024d4f3b tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697" status: 200 len: 1521 microversion: 2.1 time: 0.179967 Aug 09 11:20:17.127689 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 159/346] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:16 2022] GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:17.371501 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-1a1d6ee9-b883-4398-8af6-1dcd9ead325e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:17.375004 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-1a1d6ee9-b883-4398-8af6-1dcd9ead325e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:17.379689 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1a1d6ee9-b883-4398-8af6-1dcd9ead325e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:17.380180 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1a1d6ee9-b883-4398-8af6-1dcd9ead325e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:17.380670 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1a1d6ee9-b883-4398-8af6-1dcd9ead325e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:17.381427 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1a1d6ee9-b883-4398-8af6-1dcd9ead325e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:17.381874 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1a1d6ee9-b883-4398-8af6-1dcd9ead325e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:17.382297 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1a1d6ee9-b883-4398-8af6-1dcd9ead325e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:17.770963 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-1a1d6ee9-b883-4398-8af6-1dcd9ead325e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:17.780094 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-1a1d6ee9-b883-4398-8af6-1dcd9ead325e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:17.781646 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-1a1d6ee9-b883-4398-8af6-1dcd9ead325e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:17.782793 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-1a1d6ee9-b883-4398-8af6-1dcd9ead325e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1720 microversion: 2.20 time: 0.416028 Aug 09 11:20:17.783462 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 188/347] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:20:17 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1720 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:20:18.148605 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-826c1460-2e87-444e-be63-b223c7df1c55 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:18.149264 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-826c1460-2e87-444e-be63-b223c7df1c55 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:18.156298 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-826c1460-2e87-444e-be63-b223c7df1c55 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:18.156898 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-826c1460-2e87-444e-be63-b223c7df1c55 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:18.157394 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-826c1460-2e87-444e-be63-b223c7df1c55 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:18.158150 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-826c1460-2e87-444e-be63-b223c7df1c55 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:18.158655 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-826c1460-2e87-444e-be63-b223c7df1c55 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:18.159126 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-826c1460-2e87-444e-be63-b223c7df1c55 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:18.170621 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-22b2351b-db03-4dcd-a9b9-a631188c6efb req-932b5aec-5c4d-4116-86b0-b724e327f257 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eee55879-1bf3-41e4-b439-0c903100e828", "tag": "e6897a01-7b9e-4865-b51f-2d3190ae1e3a"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:20:18.180591 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-22b2351b-db03-4dcd-a9b9-a631188c6efb req-932b5aec-5c4d-4116-86b0-b724e327f257 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:18.181116 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-22b2351b-db03-4dcd-a9b9-a631188c6efb req-932b5aec-5c4d-4116-86b0-b724e327f257 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:18.181823 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-22b2351b-db03-4dcd-a9b9-a631188c6efb req-932b5aec-5c4d-4116-86b0-b724e327f257 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:18.194228 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-22b2351b-db03-4dcd-a9b9-a631188c6efb req-932b5aec-5c4d-4116-86b0-b724e327f257 service nova] Creating event network-changed:e6897a01-7b9e-4865-b51f-2d3190ae1e3a for instance eee55879-1bf3-41e4-b439-0c903100e828 on hv-cinder-85251 Aug 09 11:20:18.200325 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-22b2351b-db03-4dcd-a9b9-a631188c6efb req-932b5aec-5c4d-4116-86b0-b724e327f257 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033241 Aug 09 11:20:18.203898 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 189/348] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:20:18.314387 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-826c1460-2e87-444e-be63-b223c7df1c55 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:18.322071 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-826c1460-2e87-444e-be63-b223c7df1c55 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697" status: 200 len: 1521 microversion: 2.1 time: 0.177868 Aug 09 11:20:18.322733 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 160/349] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:18 2022] GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:18.809582 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-4ca37e33-8d11-45df-8551-8ea0942d61e5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:18.810228 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-4ca37e33-8d11-45df-8551-8ea0942d61e5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:18.817133 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4ca37e33-8d11-45df-8551-8ea0942d61e5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:18.817603 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4ca37e33-8d11-45df-8551-8ea0942d61e5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:18.818030 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4ca37e33-8d11-45df-8551-8ea0942d61e5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:18.818892 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4ca37e33-8d11-45df-8551-8ea0942d61e5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:18.819334 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4ca37e33-8d11-45df-8551-8ea0942d61e5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:18.819747 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4ca37e33-8d11-45df-8551-8ea0942d61e5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:19.081459 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-4ca37e33-8d11-45df-8551-8ea0942d61e5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:19.090916 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-4ca37e33-8d11-45df-8551-8ea0942d61e5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:19.092564 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-4ca37e33-8d11-45df-8551-8ea0942d61e5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:19.093764 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-4ca37e33-8d11-45df-8551-8ea0942d61e5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1720 microversion: 2.20 time: 0.290511 Aug 09 11:20:19.094334 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 190/350] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:20:18 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1720 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:20:19.344124 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-6b4613b3-596a-4880-842b-8e133ab41b21 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:19.345354 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-6b4613b3-596a-4880-842b-8e133ab41b21 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:19.354033 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6b4613b3-596a-4880-842b-8e133ab41b21 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:19.354937 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6b4613b3-596a-4880-842b-8e133ab41b21 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:19.355533 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6b4613b3-596a-4880-842b-8e133ab41b21 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:19.356426 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6b4613b3-596a-4880-842b-8e133ab41b21 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:19.357230 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6b4613b3-596a-4880-842b-8e133ab41b21 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:19.357801 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6b4613b3-596a-4880-842b-8e133ab41b21 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:19.513051 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-6b4613b3-596a-4880-842b-8e133ab41b21 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:19.528452 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-6b4613b3-596a-4880-842b-8e133ab41b21 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697" status: 200 len: 1521 microversion: 2.1 time: 0.189025 Aug 09 11:20:19.529277 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 161/351] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:19 2022] GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:20.116920 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-6c5a28d5-8451-44d9-8fbe-0f6993413c40 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:20.117536 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-6c5a28d5-8451-44d9-8fbe-0f6993413c40 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:20.125185 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6c5a28d5-8451-44d9-8fbe-0f6993413c40 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:20.125681 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6c5a28d5-8451-44d9-8fbe-0f6993413c40 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:20.126111 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6c5a28d5-8451-44d9-8fbe-0f6993413c40 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:20.126819 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6c5a28d5-8451-44d9-8fbe-0f6993413c40 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:20.127271 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6c5a28d5-8451-44d9-8fbe-0f6993413c40 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:20.127728 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6c5a28d5-8451-44d9-8fbe-0f6993413c40 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:20.271694 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-6c5a28d5-8451-44d9-8fbe-0f6993413c40 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:20.279809 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-6c5a28d5-8451-44d9-8fbe-0f6993413c40 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:20.281515 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-6c5a28d5-8451-44d9-8fbe-0f6993413c40 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:20.282679 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-6c5a28d5-8451-44d9-8fbe-0f6993413c40 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1720 microversion: 2.20 time: 0.169807 Aug 09 11:20:20.283215 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 191/352] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:20:20 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:20:20.397725 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-aeec501b-0c82-44ff-9a75-690c28465b94 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1173812672", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1363296231", "security_groups": [{"name": "tempest-secgroup-smoke-1415233798"}], "networks": [{"uuid": "3fcd0c32-2c95-4a03-919c-b2084a161aae"}], "block_device_mapping_v2": [{"uuid": "8aecd9a2-9c49-422c-8d17-1ddb17125772", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:20:20.464104 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-c1afd6ad-2819-4ae2-8dfe-331a8fbf10a0 req-e3703e0a-5518-440b-858c-690cb692f455 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69542c8c-90b6-49a4-aed3-c229168f215f", "name": "network-vif-unplugged", "status": "completed", "tag": "e9e1072a-3971-440e-9a60-ba15e5db60f3"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:20:20.474021 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-c1afd6ad-2819-4ae2-8dfe-331a8fbf10a0 req-e3703e0a-5518-440b-858c-690cb692f455 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:20.474582 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-c1afd6ad-2819-4ae2-8dfe-331a8fbf10a0 req-e3703e0a-5518-440b-858c-690cb692f455 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:20.475006 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-c1afd6ad-2819-4ae2-8dfe-331a8fbf10a0 req-e3703e0a-5518-440b-858c-690cb692f455 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:20.489339 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-c1afd6ad-2819-4ae2-8dfe-331a8fbf10a0 req-e3703e0a-5518-440b-858c-690cb692f455 service nova] Creating event network-vif-unplugged:e9e1072a-3971-440e-9a60-ba15e5db60f3 for instance 69542c8c-90b6-49a4-aed3-c229168f215f on hv-cinder-85251 Aug 09 11:20:20.499374 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-c1afd6ad-2819-4ae2-8dfe-331a8fbf10a0 req-e3703e0a-5518-440b-858c-690cb692f455 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039346 Aug 09 11:20:20.500313 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 192/353] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:20:20.520299 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.network.neutron [None req-aeec501b-0c82-44ff-9a75-690c28465b94 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] validate_networks() for [('3fcd0c32-2c95-4a03-919c-b2084a161aae', None, None, None, None, None)] {{(pid=117684) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 11:20:20.552589 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-3d552366-32dd-4b95-b814-296b80bdfac3 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:20.553291 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-3d552366-32dd-4b95-b814-296b80bdfac3 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:20.559497 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3d552366-32dd-4b95-b814-296b80bdfac3 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:20.559959 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3d552366-32dd-4b95-b814-296b80bdfac3 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:20.560437 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3d552366-32dd-4b95-b814-296b80bdfac3 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:20.561154 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3d552366-32dd-4b95-b814-296b80bdfac3 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:20.561594 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3d552366-32dd-4b95-b814-296b80bdfac3 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:20.562041 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3d552366-32dd-4b95-b814-296b80bdfac3 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:20.761150 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-3d552366-32dd-4b95-b814-296b80bdfac3 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:20.769501 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-3d552366-32dd-4b95-b814-296b80bdfac3 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697" status: 200 len: 1521 microversion: 2.1 time: 0.222043 Aug 09 11:20:20.770076 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 193/354] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:20 2022] GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:20:20.974814 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-aeec501b-0c82-44ff-9a75-690c28465b94 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Flavor limits 0:0:0 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 11:20:20.975238 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-aeec501b-0c82-44ff-9a75-690c28465b94 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Image limits 0:0:0 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 11:20:20.975709 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-aeec501b-0c82-44ff-9a75-690c28465b94 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Flavor pref 0:0:0 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 11:20:20.976114 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-aeec501b-0c82-44ff-9a75-690c28465b94 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Image pref 0:0:0 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 11:20:20.976558 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-aeec501b-0c82-44ff-9a75-690c28465b94 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 11:20:20.986908 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-aeec501b-0c82-44ff-9a75-690c28465b94 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:20.987381 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-aeec501b-0c82-44ff-9a75-690c28465b94 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:20.987814 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-aeec501b-0c82-44ff-9a75-690c28465b94 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:20.988558 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-aeec501b-0c82-44ff-9a75-690c28465b94 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:20.988989 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-aeec501b-0c82-44ff-9a75-690c28465b94 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:20.989407 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-aeec501b-0c82-44ff-9a75-690c28465b94 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:21.008967 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.quota [None req-aeec501b-0c82-44ff-9a75-690c28465b94 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Getting quotas for project 821c49e74c4e4767b872c300ac829345. Resources: {'cores', 'instances', 'ram'} {{(pid=117684) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:20:21.014317 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.quota [None req-aeec501b-0c82-44ff-9a75-690c28465b94 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Getting quotas for user 0fb97bc956b14342990b1dd5d8c7be95 and project 821c49e74c4e4767b872c300ac829345. Resources: {'cores', 'instances', 'ram'} {{(pid=117684) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:20:21.075119 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-aeec501b-0c82-44ff-9a75-690c28465b94 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Going to run 1 instances... {{(pid=117684) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 11:20:21.077984 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-aeec501b-0c82-44ff-9a75-690c28465b94 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8aecd9a2-9c49-422c-8d17-1ddb17125772',volume_size=None,volume_type=None)] {{(pid=117684) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 11:20:21.221667 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-aeec501b-0c82-44ff-9a75-690c28465b94 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.828040 Aug 09 11:20:21.222855 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 162/355] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 9 11:20:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 11:20:21.233368 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-71b441c6-f63d-4b53-9bf3-793f7b203079 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:21.234568 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-71b441c6-f63d-4b53-9bf3-793f7b203079 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:21.289228 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-71b441c6-f63d-4b53-9bf3-793f7b203079 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:21.296751 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-71b441c6-f63d-4b53-9bf3-793f7b203079 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1089 microversion: 2.1 time: 0.067280 Aug 09 11:20:21.297324 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 194/356] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:21 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1089 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:21.306242 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-fa5c8a30-7af6-40e7-843c-8a087dba2ca9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:21.306854 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-fa5c8a30-7af6-40e7-843c-8a087dba2ca9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:21.313288 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-fa5c8a30-7af6-40e7-843c-8a087dba2ca9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:21.313918 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-fa5c8a30-7af6-40e7-843c-8a087dba2ca9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:21.314345 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-fa5c8a30-7af6-40e7-843c-8a087dba2ca9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:21.315032 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-fa5c8a30-7af6-40e7-843c-8a087dba2ca9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:21.315480 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-fa5c8a30-7af6-40e7-843c-8a087dba2ca9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:21.315935 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-fa5c8a30-7af6-40e7-843c-8a087dba2ca9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:21.459866 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-fa5c8a30-7af6-40e7-843c-8a087dba2ca9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:21.469479 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-fa5c8a30-7af6-40e7-843c-8a087dba2ca9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:21.471315 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-fa5c8a30-7af6-40e7-843c-8a087dba2ca9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:21.472626 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-fa5c8a30-7af6-40e7-843c-8a087dba2ca9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1720 microversion: 2.20 time: 0.170621 Aug 09 11:20:21.473441 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 163/357] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:20:21 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:20:21.789866 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-a754c8be-0798-43fd-b7db-39e3f7035651 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:21.790470 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-a754c8be-0798-43fd-b7db-39e3f7035651 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:21.797137 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a754c8be-0798-43fd-b7db-39e3f7035651 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:21.797646 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a754c8be-0798-43fd-b7db-39e3f7035651 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:21.798075 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a754c8be-0798-43fd-b7db-39e3f7035651 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:21.798792 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a754c8be-0798-43fd-b7db-39e3f7035651 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:21.799282 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a754c8be-0798-43fd-b7db-39e3f7035651 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:21.799699 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a754c8be-0798-43fd-b7db-39e3f7035651 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:21.935834 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-a754c8be-0798-43fd-b7db-39e3f7035651 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:21.944209 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-a754c8be-0798-43fd-b7db-39e3f7035651 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697" status: 200 len: 1521 microversion: 2.1 time: 0.158161 Aug 09 11:20:21.944823 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 195/358] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:21 2022] GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:22.319027 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-49623630-3c8c-4a78-a885-29b716d98705 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:22.320024 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-49623630-3c8c-4a78-a885-29b716d98705 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:22.332040 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-49623630-3c8c-4a78-a885-29b716d98705 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:22.333046 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-49623630-3c8c-4a78-a885-29b716d98705 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:22.333551 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-49623630-3c8c-4a78-a885-29b716d98705 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:22.334357 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-49623630-3c8c-4a78-a885-29b716d98705 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:22.335216 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-49623630-3c8c-4a78-a885-29b716d98705 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:22.335774 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-49623630-3c8c-4a78-a885-29b716d98705 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:22.398798 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-49623630-3c8c-4a78-a885-29b716d98705 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:22.407139 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-49623630-3c8c-4a78-a885-29b716d98705 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1131 microversion: 2.1 time: 0.093913 Aug 09 11:20:22.407810 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 164/359] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:22 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1131 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:22.499206 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-267ff5ec-47d8-491f-9050-15d2c86fec26 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:22.500317 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-267ff5ec-47d8-491f-9050-15d2c86fec26 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:22.509879 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-267ff5ec-47d8-491f-9050-15d2c86fec26 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:22.510527 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-267ff5ec-47d8-491f-9050-15d2c86fec26 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:22.511187 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-267ff5ec-47d8-491f-9050-15d2c86fec26 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:22.512251 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-267ff5ec-47d8-491f-9050-15d2c86fec26 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:22.513011 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-267ff5ec-47d8-491f-9050-15d2c86fec26 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:22.513546 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-267ff5ec-47d8-491f-9050-15d2c86fec26 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:22.667685 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-267ff5ec-47d8-491f-9050-15d2c86fec26 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:22.677383 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-267ff5ec-47d8-491f-9050-15d2c86fec26 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:22.678880 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-267ff5ec-47d8-491f-9050-15d2c86fec26 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:22.680401 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-267ff5ec-47d8-491f-9050-15d2c86fec26 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1720 microversion: 2.20 time: 0.186799 Aug 09 11:20:22.681240 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 196/360] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:20:22 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1720 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:20:22.965042 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-1de6b9e6-7d1c-4b17-8886-52c73e5637aa tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:22.965633 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-1de6b9e6-7d1c-4b17-8886-52c73e5637aa tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:22.972234 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1de6b9e6-7d1c-4b17-8886-52c73e5637aa tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:22.972753 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1de6b9e6-7d1c-4b17-8886-52c73e5637aa tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:22.973178 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1de6b9e6-7d1c-4b17-8886-52c73e5637aa tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:22.973859 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1de6b9e6-7d1c-4b17-8886-52c73e5637aa tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:22.974302 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1de6b9e6-7d1c-4b17-8886-52c73e5637aa tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:22.974714 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1de6b9e6-7d1c-4b17-8886-52c73e5637aa tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:23.120115 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-1de6b9e6-7d1c-4b17-8886-52c73e5637aa tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:23.128434 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-1de6b9e6-7d1c-4b17-8886-52c73e5637aa tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697" status: 200 len: 1501 microversion: 2.1 time: 0.167198 Aug 09 11:20:23.129082 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 165/361] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:22 2022] GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697 => generated 1501 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:23.149152 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-af3d47a6-368a-46aa-aec9-c4720d31e903 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:23.149759 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-af3d47a6-368a-46aa-aec9-c4720d31e903 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:23.156930 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-af3d47a6-368a-46aa-aec9-c4720d31e903 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:23.157482 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-af3d47a6-368a-46aa-aec9-c4720d31e903 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:23.157925 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-af3d47a6-368a-46aa-aec9-c4720d31e903 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:23.158615 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-af3d47a6-368a-46aa-aec9-c4720d31e903 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:23.159139 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-af3d47a6-368a-46aa-aec9-c4720d31e903 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:23.159622 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-af3d47a6-368a-46aa-aec9-c4720d31e903 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:23.164334 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell1:SELECT=100 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:23.298361 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-af3d47a6-368a-46aa-aec9-c4720d31e903 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:23.306275 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-af3d47a6-368a-46aa-aec9-c4720d31e903 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1516 microversion: 2.1 time: 0.160921 Aug 09 11:20:23.306920 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 197/362] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:23 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:23.432874 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-04e80466-4575-49de-a8b1-5955d9417f28 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:23.433786 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-04e80466-4575-49de-a8b1-5955d9417f28 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:23.444132 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-04e80466-4575-49de-a8b1-5955d9417f28 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:23.444780 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-04e80466-4575-49de-a8b1-5955d9417f28 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:23.445258 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-04e80466-4575-49de-a8b1-5955d9417f28 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:23.446249 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-04e80466-4575-49de-a8b1-5955d9417f28 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:23.446747 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-04e80466-4575-49de-a8b1-5955d9417f28 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:23.447365 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-04e80466-4575-49de-a8b1-5955d9417f28 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:23.518642 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-04e80466-4575-49de-a8b1-5955d9417f28 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:23.528561 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-04e80466-4575-49de-a8b1-5955d9417f28 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1187 microversion: 2.1 time: 0.101305 Aug 09 11:20:23.529144 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 166/363] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:23 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1187 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:23.706101 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-9ff12b8c-5b9e-44f4-8304-6efb515e7195 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:23.706670 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-9ff12b8c-5b9e-44f4-8304-6efb515e7195 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:23.713169 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9ff12b8c-5b9e-44f4-8304-6efb515e7195 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:23.713659 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9ff12b8c-5b9e-44f4-8304-6efb515e7195 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:23.714086 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9ff12b8c-5b9e-44f4-8304-6efb515e7195 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:23.714768 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9ff12b8c-5b9e-44f4-8304-6efb515e7195 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:23.715197 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9ff12b8c-5b9e-44f4-8304-6efb515e7195 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:23.715684 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9ff12b8c-5b9e-44f4-8304-6efb515e7195 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:23.857976 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-9ff12b8c-5b9e-44f4-8304-6efb515e7195 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:23.866914 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-9ff12b8c-5b9e-44f4-8304-6efb515e7195 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:23.868450 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-9ff12b8c-5b9e-44f4-8304-6efb515e7195 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:23.869646 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-9ff12b8c-5b9e-44f4-8304-6efb515e7195 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1663 microversion: 2.20 time: 0.167752 Aug 09 11:20:23.870208 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 198/364] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:20:23 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1663 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:20:23.893271 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-4ee2e487-952f-409c-a5b2-2c998c3a66b8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "528f6b86-d36b-4619-b6ea-25ece12bf1e1"}} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:20:23.895705 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-4ee2e487-952f-409c-a5b2-2c998c3a66b8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:23.902258 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4ee2e487-952f-409c-a5b2-2c998c3a66b8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:23.903185 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4ee2e487-952f-409c-a5b2-2c998c3a66b8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:23.903643 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4ee2e487-952f-409c-a5b2-2c998c3a66b8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:23.904382 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4ee2e487-952f-409c-a5b2-2c998c3a66b8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:23.904838 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4ee2e487-952f-409c-a5b2-2c998c3a66b8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:23.905261 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4ee2e487-952f-409c-a5b2-2c998c3a66b8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:24.244121 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-4ee2e487-952f-409c-a5b2-2c998c3a66b8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "POST /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.355381 Aug 09 11:20:24.244990 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 167/365] 10.222.0.27 () {62 vars in 1364 bytes} [Tue Aug 9 11:20:23 2022] POST /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f/os-volume_attachments => generated 188 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 11:20:24.397673 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-d9ccfeb7-d813-4126-bdc2-3a4526435529 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:20:24.398277 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-d9ccfeb7-d813-4126-bdc2-3a4526435529 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:24.404191 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d9ccfeb7-d813-4126-bdc2-3a4526435529 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:24.404708 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d9ccfeb7-d813-4126-bdc2-3a4526435529 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:24.405139 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d9ccfeb7-d813-4126-bdc2-3a4526435529 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:24.405831 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d9ccfeb7-d813-4126-bdc2-3a4526435529 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:24.406350 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d9ccfeb7-d813-4126-bdc2-3a4526435529 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:24.406820 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d9ccfeb7-d813-4126-bdc2-3a4526435529 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:24.451490 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-d9ccfeb7-d813-4126-bdc2-3a4526435529 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117685) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 09 11:20:24.526817 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-d9ccfeb7-d813-4126-bdc2-3a4526435529 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "POST /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f/action" status: 202 len: 0 microversion: 2.20 time: 0.133091 Aug 09 11:20:24.527456 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 199/366] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Aug 9 11:20:24 2022] POST /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 11:20:24.535854 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-996118aa-91ca-45e6-9707-94380621ccce tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:24.536636 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-996118aa-91ca-45e6-9707-94380621ccce tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:24.544392 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-996118aa-91ca-45e6-9707-94380621ccce tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:24.545071 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-996118aa-91ca-45e6-9707-94380621ccce tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:24.545646 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-996118aa-91ca-45e6-9707-94380621ccce tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:24.546656 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-996118aa-91ca-45e6-9707-94380621ccce tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:24.547175 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-996118aa-91ca-45e6-9707-94380621ccce tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:24.547741 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-996118aa-91ca-45e6-9707-94380621ccce tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:24.551213 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-3a0e0858-3c22-4f82-ae3c-06a9481c90e2 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:24.552071 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-3a0e0858-3c22-4f82-ae3c-06a9481c90e2 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:24.561441 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3a0e0858-3c22-4f82-ae3c-06a9481c90e2 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:24.562151 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3a0e0858-3c22-4f82-ae3c-06a9481c90e2 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:24.562689 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3a0e0858-3c22-4f82-ae3c-06a9481c90e2 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:24.563595 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3a0e0858-3c22-4f82-ae3c-06a9481c90e2 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:24.564124 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3a0e0858-3c22-4f82-ae3c-06a9481c90e2 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:24.564772 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3a0e0858-3c22-4f82-ae3c-06a9481c90e2 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:24.827233 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-996118aa-91ca-45e6-9707-94380621ccce tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:24.840897 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-996118aa-91ca-45e6-9707-94380621ccce tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:24.846133 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-996118aa-91ca-45e6-9707-94380621ccce tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:24.851161 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-3a0e0858-3c22-4f82-ae3c-06a9481c90e2 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:24.861944 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-996118aa-91ca-45e6-9707-94380621ccce tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1749 microversion: 2.20 time: 0.329958 Aug 09 11:20:24.864713 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-3a0e0858-3c22-4f82-ae3c-06a9481c90e2 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1273 microversion: 2.1 time: 0.317628 Aug 09 11:20:24.865037 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 168/367] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:20:24 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1749 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:20:24.866357 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 200/368] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:24 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1273 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:24.871732 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-b7d9cd44-150d-4357-b3a6-42a3aa475c46 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:20:24.874504 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-b7d9cd44-150d-4357-b3a6-42a3aa475c46 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:24.894093 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b7d9cd44-150d-4357-b3a6-42a3aa475c46 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:24.895413 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b7d9cd44-150d-4357-b3a6-42a3aa475c46 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:24.895951 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b7d9cd44-150d-4357-b3a6-42a3aa475c46 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:24.896987 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b7d9cd44-150d-4357-b3a6-42a3aa475c46 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:24.897673 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b7d9cd44-150d-4357-b3a6-42a3aa475c46 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:24.901618 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b7d9cd44-150d-4357-b3a6-42a3aa475c46 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:24.955751 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.objects.instance [None req-b7d9cd44-150d-4357-b3a6-42a3aa475c46 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lazy-loading 'flavor' on Instance uuid 41447c00-5903-4495-9529-ec080a0840c1 {{(pid=117684) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:20:24.975285 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:25.056004 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-b7d9cd44-150d-4357-b3a6-42a3aa475c46 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "POST /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1/action" status: 200 len: 32 microversion: 2.1 time: 0.189582 Aug 09 11:20:25.057130 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 169/369] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 9 11:20:24 2022] POST /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1/action => generated 32 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 11:20:25.067316 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-5aa25e26-8772-4ca2-a77c-34166be49369 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:25.068420 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-5aa25e26-8772-4ca2-a77c-34166be49369 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:25.075900 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5aa25e26-8772-4ca2-a77c-34166be49369 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:25.076542 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5aa25e26-8772-4ca2-a77c-34166be49369 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:25.077051 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5aa25e26-8772-4ca2-a77c-34166be49369 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:25.077902 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5aa25e26-8772-4ca2-a77c-34166be49369 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:25.078462 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5aa25e26-8772-4ca2-a77c-34166be49369 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:25.078885 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5aa25e26-8772-4ca2-a77c-34166be49369 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:25.270775 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-5aa25e26-8772-4ca2-a77c-34166be49369 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:25.284520 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-5aa25e26-8772-4ca2-a77c-34166be49369 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.221569 Aug 09 11:20:25.285529 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 201/370] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:25 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:25.888824 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-5f564cef-0919-43bf-905c-969307262b0a tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:25.889875 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-5f564cef-0919-43bf-905c-969307262b0a tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:25.893608 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-333351e6-a0b5-4eea-ae9b-da0ebd5c0be0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:25.894527 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-333351e6-a0b5-4eea-ae9b-da0ebd5c0be0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:25.900565 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5f564cef-0919-43bf-905c-969307262b0a tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:25.901242 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5f564cef-0919-43bf-905c-969307262b0a tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:25.901609 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-333351e6-a0b5-4eea-ae9b-da0ebd5c0be0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:25.901988 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5f564cef-0919-43bf-905c-969307262b0a tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:25.902897 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5f564cef-0919-43bf-905c-969307262b0a tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:25.903131 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-333351e6-a0b5-4eea-ae9b-da0ebd5c0be0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:25.903672 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-333351e6-a0b5-4eea-ae9b-da0ebd5c0be0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:25.903799 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5f564cef-0919-43bf-905c-969307262b0a tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:25.904439 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5f564cef-0919-43bf-905c-969307262b0a tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:25.904952 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-333351e6-a0b5-4eea-ae9b-da0ebd5c0be0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:25.905540 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-333351e6-a0b5-4eea-ae9b-da0ebd5c0be0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:25.906218 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-333351e6-a0b5-4eea-ae9b-da0ebd5c0be0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:26.135177 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-333351e6-a0b5-4eea-ae9b-da0ebd5c0be0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:26.147231 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-333351e6-a0b5-4eea-ae9b-da0ebd5c0be0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:26.149622 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-333351e6-a0b5-4eea-ae9b-da0ebd5c0be0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:26.151004 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-333351e6-a0b5-4eea-ae9b-da0ebd5c0be0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1751 microversion: 2.20 time: 0.263716 Aug 09 11:20:26.152388 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 202/371] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:20:25 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1751 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 11:20:26.160009 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-39de26fc-f1c7-455c-bb99-cfd74de922a2 req-d1a13a09-dbc0-4b49-815b-803a5503a6b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b683e1f9-1d37-46d4-a7a1-9f15b514336e", "tag": "afc665af-24eb-4ff3-8263-bd971e0a7488"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:20:26.160304 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-5f564cef-0919-43bf-905c-969307262b0a tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:26.168056 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-5f564cef-0919-43bf-905c-969307262b0a tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1261 microversion: 2.1 time: 0.285010 Aug 09 11:20:26.169975 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 170/372] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:25 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1261 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:26.173417 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-39de26fc-f1c7-455c-bb99-cfd74de922a2 req-d1a13a09-dbc0-4b49-815b-803a5503a6b6 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:26.173933 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-39de26fc-f1c7-455c-bb99-cfd74de922a2 req-d1a13a09-dbc0-4b49-815b-803a5503a6b6 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:26.174537 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-39de26fc-f1c7-455c-bb99-cfd74de922a2 req-d1a13a09-dbc0-4b49-815b-803a5503a6b6 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:26.185889 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-39de26fc-f1c7-455c-bb99-cfd74de922a2 req-d1a13a09-dbc0-4b49-815b-803a5503a6b6 service nova] Creating event network-changed:afc665af-24eb-4ff3-8263-bd971e0a7488 for instance b683e1f9-1d37-46d4-a7a1-9f15b514336e on hv-cinder-85251 Aug 09 11:20:26.190668 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-39de26fc-f1c7-455c-bb99-cfd74de922a2 req-d1a13a09-dbc0-4b49-815b-803a5503a6b6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036713 Aug 09 11:20:26.191251 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 203/373] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:20:26.309481 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-df5cd41e-5016-4202-8966-4660719e8b89 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:26.310326 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-df5cd41e-5016-4202-8966-4660719e8b89 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:26.314345 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:26.318248 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-df5cd41e-5016-4202-8966-4660719e8b89 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:26.318748 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-df5cd41e-5016-4202-8966-4660719e8b89 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:26.319172 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-df5cd41e-5016-4202-8966-4660719e8b89 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:26.319874 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-df5cd41e-5016-4202-8966-4660719e8b89 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:26.320313 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-df5cd41e-5016-4202-8966-4660719e8b89 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:26.320758 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-df5cd41e-5016-4202-8966-4660719e8b89 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:26.466369 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-df5cd41e-5016-4202-8966-4660719e8b89 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:26.474631 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-df5cd41e-5016-4202-8966-4660719e8b89 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.171160 Aug 09 11:20:26.475205 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 171/374] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:26 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:26.841820 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-dcaeb40d-b5f9-42af-9a58-f74ff68c2864 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d0b58cbb-9df2-4aba-b2b6-99d0062dfae7", "device": "/dev/sdb"}} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:20:26.845058 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-dcaeb40d-b5f9-42af-9a58-f74ff68c2864 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] [instance: 14c1cdbe-3b15-499a-88b5-7f86dfc5501b] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:26.851164 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-dcaeb40d-b5f9-42af-9a58-f74ff68c2864 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:26.851633 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-dcaeb40d-b5f9-42af-9a58-f74ff68c2864 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:26.852057 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-dcaeb40d-b5f9-42af-9a58-f74ff68c2864 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:26.852762 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-dcaeb40d-b5f9-42af-9a58-f74ff68c2864 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:26.853198 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-dcaeb40d-b5f9-42af-9a58-f74ff68c2864 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:26.853605 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-dcaeb40d-b5f9-42af-9a58-f74ff68c2864 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:27.159977 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-dcaeb40d-b5f9-42af-9a58-f74ff68c2864 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] 10.222.0.27 "POST /compute/v2.1/servers/14c1cdbe-3b15-499a-88b5-7f86dfc5501b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.322125 Aug 09 11:20:27.160826 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 204/375] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Aug 9 11:20:26 2022] POST /compute/v2.1/servers/14c1cdbe-3b15-499a-88b5-7f86dfc5501b/os-volume_attachments => generated 194 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:20:27.176795 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-62adb506-079a-4652-a6db-ea06e4d9ce78 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:27.177427 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-62adb506-079a-4652-a6db-ea06e4d9ce78 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:27.193311 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-62adb506-079a-4652-a6db-ea06e4d9ce78 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:27.195233 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-0cc8096e-5720-445f-9a6e-163cae6e8441 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:27.195951 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-0cc8096e-5720-445f-9a6e-163cae6e8441 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:27.201107 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-62adb506-079a-4652-a6db-ea06e4d9ce78 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:27.201716 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-62adb506-079a-4652-a6db-ea06e4d9ce78 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:27.202453 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-62adb506-079a-4652-a6db-ea06e4d9ce78 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:27.203196 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-62adb506-079a-4652-a6db-ea06e4d9ce78 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:27.203633 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-62adb506-079a-4652-a6db-ea06e4d9ce78 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:27.221842 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0cc8096e-5720-445f-9a6e-163cae6e8441 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:27.222559 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0cc8096e-5720-445f-9a6e-163cae6e8441 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:27.223149 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0cc8096e-5720-445f-9a6e-163cae6e8441 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:27.224063 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0cc8096e-5720-445f-9a6e-163cae6e8441 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:27.224736 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0cc8096e-5720-445f-9a6e-163cae6e8441 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:27.225193 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0cc8096e-5720-445f-9a6e-163cae6e8441 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:27.436347 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-62adb506-079a-4652-a6db-ea06e4d9ce78 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:27.445398 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-62adb506-079a-4652-a6db-ea06e4d9ce78 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:27.445873 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-0cc8096e-5720-445f-9a6e-163cae6e8441 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:27.446888 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-62adb506-079a-4652-a6db-ea06e4d9ce78 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:27.448037 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-62adb506-079a-4652-a6db-ea06e4d9ce78 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1751 microversion: 2.20 time: 0.275733 Aug 09 11:20:27.448751 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 172/376] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:20:27 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1751 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:20:27.454425 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-0cc8096e-5720-445f-9a6e-163cae6e8441 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1261 microversion: 2.1 time: 0.266961 Aug 09 11:20:27.455124 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 205/377] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:27 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1261 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:27.495606 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-a082f1e4-588f-4942-97d0-d65f64898675 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:27.496207 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-a082f1e4-588f-4942-97d0-d65f64898675 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:27.502307 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a082f1e4-588f-4942-97d0-d65f64898675 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:27.502782 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a082f1e4-588f-4942-97d0-d65f64898675 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:27.503208 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a082f1e4-588f-4942-97d0-d65f64898675 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:27.503891 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a082f1e4-588f-4942-97d0-d65f64898675 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:27.504605 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a082f1e4-588f-4942-97d0-d65f64898675 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:27.505018 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a082f1e4-588f-4942-97d0-d65f64898675 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:27.652638 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-a082f1e4-588f-4942-97d0-d65f64898675 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:27.661788 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-a082f1e4-588f-4942-97d0-d65f64898675 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.169976 Aug 09 11:20:27.668781 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 173/378] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:27 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:28.471965 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-6585f42a-0154-4519-b376-20c263641c8b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:28.472703 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-6585f42a-0154-4519-b376-20c263641c8b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:28.478901 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-458e8dc8-2837-4761-8d03-e2e4f437249a tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:28.480058 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-458e8dc8-2837-4761-8d03-e2e4f437249a tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:28.481255 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6585f42a-0154-4519-b376-20c263641c8b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:28.486453 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6585f42a-0154-4519-b376-20c263641c8b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:28.486453 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6585f42a-0154-4519-b376-20c263641c8b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:28.486453 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6585f42a-0154-4519-b376-20c263641c8b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:28.486453 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6585f42a-0154-4519-b376-20c263641c8b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:28.486758 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6585f42a-0154-4519-b376-20c263641c8b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:28.494214 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-458e8dc8-2837-4761-8d03-e2e4f437249a tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:28.495077 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-458e8dc8-2837-4761-8d03-e2e4f437249a tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:28.495716 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-458e8dc8-2837-4761-8d03-e2e4f437249a tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:28.496448 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-458e8dc8-2837-4761-8d03-e2e4f437249a tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:28.496878 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-458e8dc8-2837-4761-8d03-e2e4f437249a tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:28.497526 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-458e8dc8-2837-4761-8d03-e2e4f437249a tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:28.695645 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-6585f42a-0154-4519-b376-20c263641c8b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:28.700078 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-458e8dc8-2837-4761-8d03-e2e4f437249a tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:28.705155 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-6585f42a-0154-4519-b376-20c263641c8b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:28.706649 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-6585f42a-0154-4519-b376-20c263641c8b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:28.707814 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-6585f42a-0154-4519-b376-20c263641c8b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.240623 Aug 09 11:20:28.708397 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 206/379] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:20:28 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:20:28.710089 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-458e8dc8-2837-4761-8d03-e2e4f437249a tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1261 microversion: 2.1 time: 0.236380 Aug 09 11:20:28.710979 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 174/380] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:28 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1261 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:28.713440 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-55d33a12-c874-4328-907b-9abc7cb0c835 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:28.714036 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-55d33a12-c874-4328-907b-9abc7cb0c835 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:28.720428 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-55d33a12-c874-4328-907b-9abc7cb0c835 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:28.720972 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-55d33a12-c874-4328-907b-9abc7cb0c835 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:28.721586 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-55d33a12-c874-4328-907b-9abc7cb0c835 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:28.722535 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-55d33a12-c874-4328-907b-9abc7cb0c835 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:28.723124 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-55d33a12-c874-4328-907b-9abc7cb0c835 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:28.723700 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-55d33a12-c874-4328-907b-9abc7cb0c835 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:28.869977 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-55d33a12-c874-4328-907b-9abc7cb0c835 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:28.878113 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-55d33a12-c874-4328-907b-9abc7cb0c835 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.168380 Aug 09 11:20:28.878664 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 207/381] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:28 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:29.731187 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-6094565e-eb3b-40ba-a2a6-eb932a07d601 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:29.732537 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-6094565e-eb3b-40ba-a2a6-eb932a07d601 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:29.732814 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-49039dcc-67d0-4d5e-9e99-98cf37a0eedf tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:29.733432 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-49039dcc-67d0-4d5e-9e99-98cf37a0eedf tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:29.740870 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-49039dcc-67d0-4d5e-9e99-98cf37a0eedf tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:29.741526 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-49039dcc-67d0-4d5e-9e99-98cf37a0eedf tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:29.741965 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-49039dcc-67d0-4d5e-9e99-98cf37a0eedf tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:29.742753 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-49039dcc-67d0-4d5e-9e99-98cf37a0eedf tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:29.743209 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-49039dcc-67d0-4d5e-9e99-98cf37a0eedf tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:29.743635 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-49039dcc-67d0-4d5e-9e99-98cf37a0eedf tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:29.743864 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6094565e-eb3b-40ba-a2a6-eb932a07d601 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:29.744607 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6094565e-eb3b-40ba-a2a6-eb932a07d601 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:29.745426 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6094565e-eb3b-40ba-a2a6-eb932a07d601 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:29.746569 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6094565e-eb3b-40ba-a2a6-eb932a07d601 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:29.747254 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6094565e-eb3b-40ba-a2a6-eb932a07d601 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:29.749466 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6094565e-eb3b-40ba-a2a6-eb932a07d601 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:29.956660 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-49039dcc-67d0-4d5e-9e99-98cf37a0eedf tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:29.961597 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-6094565e-eb3b-40ba-a2a6-eb932a07d601 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:29.966041 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-49039dcc-67d0-4d5e-9e99-98cf37a0eedf tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1261 microversion: 2.1 time: 0.237136 Aug 09 11:20:29.966944 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 208/382] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:29 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1261 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:20:29.971919 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-f2f21568-5410-4085-9ee8-1fab2ab976ed tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:29.972784 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-f2f21568-5410-4085-9ee8-1fab2ab976ed tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:29.979887 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-6094565e-eb3b-40ba-a2a6-eb932a07d601 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:29.980182 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f2f21568-5410-4085-9ee8-1fab2ab976ed tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:29.980871 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f2f21568-5410-4085-9ee8-1fab2ab976ed tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:29.981305 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f2f21568-5410-4085-9ee8-1fab2ab976ed tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:29.981871 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-6094565e-eb3b-40ba-a2a6-eb932a07d601 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:29.982004 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f2f21568-5410-4085-9ee8-1fab2ab976ed tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:29.982453 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f2f21568-5410-4085-9ee8-1fab2ab976ed tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:29.982873 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f2f21568-5410-4085-9ee8-1fab2ab976ed tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:29.983427 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-6094565e-eb3b-40ba-a2a6-eb932a07d601 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.256270 Aug 09 11:20:29.984088 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 175/383] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:20:29 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:20:30.138746 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-f2f21568-5410-4085-9ee8-1fab2ab976ed tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:30.146919 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-f2f21568-5410-4085-9ee8-1fab2ab976ed tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.178760 Aug 09 11:20:30.147484 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 209/384] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:29 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:30.987879 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-5879b2c7-6057-4d2d-b850-c75018988077 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:30.989589 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-5879b2c7-6057-4d2d-b850-c75018988077 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:30.995939 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell0:SELECT=2 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:30.998236 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5879b2c7-6057-4d2d-b850-c75018988077 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:30.999191 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5879b2c7-6057-4d2d-b850-c75018988077 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:30.999849 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5879b2c7-6057-4d2d-b850-c75018988077 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:31.001040 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5879b2c7-6057-4d2d-b850-c75018988077 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:31.001737 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5879b2c7-6057-4d2d-b850-c75018988077 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:31.002370 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5879b2c7-6057-4d2d-b850-c75018988077 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:31.014154 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-94b7c929-2255-4299-aa32-7a9ad09918ff tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:31.015080 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-94b7c929-2255-4299-aa32-7a9ad09918ff tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:31.022243 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell0:SELECT=6 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:31.031873 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-94b7c929-2255-4299-aa32-7a9ad09918ff tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:31.032391 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-94b7c929-2255-4299-aa32-7a9ad09918ff tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:31.032822 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-94b7c929-2255-4299-aa32-7a9ad09918ff tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:31.033553 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-94b7c929-2255-4299-aa32-7a9ad09918ff tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:31.033992 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-94b7c929-2255-4299-aa32-7a9ad09918ff tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:31.034402 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-94b7c929-2255-4299-aa32-7a9ad09918ff tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:31.223897 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-5879b2c7-6057-4d2d-b850-c75018988077 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:31.231448 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-5879b2c7-6057-4d2d-b850-c75018988077 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1261 microversion: 2.1 time: 0.247737 Aug 09 11:20:31.232029 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 176/385] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:30 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1261 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:31.234781 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-94b7c929-2255-4299-aa32-7a9ad09918ff tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:31.237277 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-e451835c-3463-45fa-98c7-4ee92b13bf5d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:31.237955 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-e451835c-3463-45fa-98c7-4ee92b13bf5d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:31.244117 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e451835c-3463-45fa-98c7-4ee92b13bf5d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:31.244407 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-94b7c929-2255-4299-aa32-7a9ad09918ff tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:31.244636 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e451835c-3463-45fa-98c7-4ee92b13bf5d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:31.245074 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e451835c-3463-45fa-98c7-4ee92b13bf5d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:31.245765 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e451835c-3463-45fa-98c7-4ee92b13bf5d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:31.245865 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-94b7c929-2255-4299-aa32-7a9ad09918ff tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:31.246355 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e451835c-3463-45fa-98c7-4ee92b13bf5d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:31.246782 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e451835c-3463-45fa-98c7-4ee92b13bf5d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:31.247005 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-94b7c929-2255-4299-aa32-7a9ad09918ff tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.243115 Aug 09 11:20:31.247565 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 210/386] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:20:31 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:20:31.405552 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-e451835c-3463-45fa-98c7-4ee92b13bf5d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:31.413848 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-e451835c-3463-45fa-98c7-4ee92b13bf5d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.180359 Aug 09 11:20:31.414386 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 177/387] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:31 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:32.258112 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-c0ec64c6-fa7a-4285-9abe-d036bbbae9fd tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:32.258706 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-c0ec64c6-fa7a-4285-9abe-d036bbbae9fd tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:32.260760 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell0:SELECT=2 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:32.267832 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c0ec64c6-fa7a-4285-9abe-d036bbbae9fd tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:32.268631 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c0ec64c6-fa7a-4285-9abe-d036bbbae9fd tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:32.269272 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c0ec64c6-fa7a-4285-9abe-d036bbbae9fd tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:32.272374 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c0ec64c6-fa7a-4285-9abe-d036bbbae9fd tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:32.272374 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c0ec64c6-fa7a-4285-9abe-d036bbbae9fd tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:32.272374 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c0ec64c6-fa7a-4285-9abe-d036bbbae9fd tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:32.275559 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-39a11934-3339-4ce7-9ca7-748c40e2220e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:32.276312 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-39a11934-3339-4ce7-9ca7-748c40e2220e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:32.285866 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-39a11934-3339-4ce7-9ca7-748c40e2220e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:32.286752 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-39a11934-3339-4ce7-9ca7-748c40e2220e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:32.287361 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-39a11934-3339-4ce7-9ca7-748c40e2220e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:32.288214 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-39a11934-3339-4ce7-9ca7-748c40e2220e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:32.288823 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-39a11934-3339-4ce7-9ca7-748c40e2220e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:32.289387 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-39a11934-3339-4ce7-9ca7-748c40e2220e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:32.505471 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-c0ec64c6-fa7a-4285-9abe-d036bbbae9fd tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:32.514639 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-39a11934-3339-4ce7-9ca7-748c40e2220e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:32.527079 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-39a11934-3339-4ce7-9ca7-748c40e2220e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:32.529961 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-c0ec64c6-fa7a-4285-9abe-d036bbbae9fd tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1261 microversion: 2.1 time: 0.278489 Aug 09 11:20:32.531053 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 211/388] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:32 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1261 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:20:32.536091 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-1edeeacb-05a9-41f7-b7da-56aae8fa238a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:32.538174 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-39a11934-3339-4ce7-9ca7-748c40e2220e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:32.539712 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-39a11934-3339-4ce7-9ca7-748c40e2220e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.268965 Aug 09 11:20:32.540532 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-1edeeacb-05a9-41f7-b7da-56aae8fa238a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:32.541289 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 178/389] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:20:32 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 11:20:32.548306 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1edeeacb-05a9-41f7-b7da-56aae8fa238a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:32.549153 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1edeeacb-05a9-41f7-b7da-56aae8fa238a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:32.549855 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1edeeacb-05a9-41f7-b7da-56aae8fa238a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:32.551405 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1edeeacb-05a9-41f7-b7da-56aae8fa238a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:32.552164 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1edeeacb-05a9-41f7-b7da-56aae8fa238a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:32.552873 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1edeeacb-05a9-41f7-b7da-56aae8fa238a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:32.558329 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:32.697746 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-1edeeacb-05a9-41f7-b7da-56aae8fa238a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:32.707745 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-1edeeacb-05a9-41f7-b7da-56aae8fa238a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.175326 Aug 09 11:20:32.708343 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 212/390] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:32 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:33.556416 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-835b69dc-4fb1-4fbc-84e2-32033971af60 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:33.557421 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-835b69dc-4fb1-4fbc-84e2-32033971af60 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:33.567413 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-835b69dc-4fb1-4fbc-84e2-32033971af60 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:33.568159 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-835b69dc-4fb1-4fbc-84e2-32033971af60 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:33.568949 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-835b69dc-4fb1-4fbc-84e2-32033971af60 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:33.569799 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-835b69dc-4fb1-4fbc-84e2-32033971af60 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:33.570041 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-7d55b058-c506-4479-970b-e715ca843722 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:33.570849 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-7d55b058-c506-4479-970b-e715ca843722 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:33.571109 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-835b69dc-4fb1-4fbc-84e2-32033971af60 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:33.571679 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-835b69dc-4fb1-4fbc-84e2-32033971af60 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:33.581123 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7d55b058-c506-4479-970b-e715ca843722 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:33.581881 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7d55b058-c506-4479-970b-e715ca843722 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:33.582706 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7d55b058-c506-4479-970b-e715ca843722 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:33.583041 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7d55b058-c506-4479-970b-e715ca843722 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:33.583705 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7d55b058-c506-4479-970b-e715ca843722 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:33.584228 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7d55b058-c506-4479-970b-e715ca843722 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:33.861520 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-835b69dc-4fb1-4fbc-84e2-32033971af60 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:33.874303 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-835b69dc-4fb1-4fbc-84e2-32033971af60 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1261 microversion: 2.1 time: 0.325433 Aug 09 11:20:33.876723 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 179/391] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:33 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1261 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:20:33.883502 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-65e8fead-ae2a-43ae-b0f7-b3331df8d0b7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:33.884112 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-65e8fead-ae2a-43ae-b0f7-b3331df8d0b7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:33.893529 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-65e8fead-ae2a-43ae-b0f7-b3331df8d0b7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:33.894065 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-65e8fead-ae2a-43ae-b0f7-b3331df8d0b7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:33.895218 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-65e8fead-ae2a-43ae-b0f7-b3331df8d0b7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:33.895940 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-65e8fead-ae2a-43ae-b0f7-b3331df8d0b7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:33.896421 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-65e8fead-ae2a-43ae-b0f7-b3331df8d0b7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:33.897161 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-7d55b058-c506-4479-970b-e715ca843722 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:33.906017 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-7d55b058-c506-4479-970b-e715ca843722 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:33.907532 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-7d55b058-c506-4479-970b-e715ca843722 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:33.908302 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-65e8fead-ae2a-43ae-b0f7-b3331df8d0b7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:33.908760 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-7d55b058-c506-4479-970b-e715ca843722 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.343992 Aug 09 11:20:33.909550 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 213/392] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:20:33 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:20:34.042703 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-65e8fead-ae2a-43ae-b0f7-b3331df8d0b7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:34.050433 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-65e8fead-ae2a-43ae-b0f7-b3331df8d0b7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.171688 Aug 09 11:20:34.051032 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 180/393] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:33 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:34.897275 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-5c272ccf-09f2-4a31-96b4-0a73910f3020 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:34.898654 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-5c272ccf-09f2-4a31-96b4-0a73910f3020 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:34.915883 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5c272ccf-09f2-4a31-96b4-0a73910f3020 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:34.915883 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5c272ccf-09f2-4a31-96b4-0a73910f3020 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:34.915883 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5c272ccf-09f2-4a31-96b4-0a73910f3020 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:34.915883 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5c272ccf-09f2-4a31-96b4-0a73910f3020 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:34.916849 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5c272ccf-09f2-4a31-96b4-0a73910f3020 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:34.916849 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5c272ccf-09f2-4a31-96b4-0a73910f3020 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:34.932484 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-1b0d7470-4079-4806-b449-260adfd46df1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:34.935267 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-1b0d7470-4079-4806-b449-260adfd46df1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:34.942138 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1b0d7470-4079-4806-b449-260adfd46df1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:34.942753 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1b0d7470-4079-4806-b449-260adfd46df1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:34.943278 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1b0d7470-4079-4806-b449-260adfd46df1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:34.944035 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1b0d7470-4079-4806-b449-260adfd46df1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:34.944519 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1b0d7470-4079-4806-b449-260adfd46df1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:34.944932 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1b0d7470-4079-4806-b449-260adfd46df1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:35.162298 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-5c272ccf-09f2-4a31-96b4-0a73910f3020 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:35.170367 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-5c272ccf-09f2-4a31-96b4-0a73910f3020 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1261 microversion: 2.1 time: 0.277337 Aug 09 11:20:35.170938 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 214/394] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:34 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1261 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:35.175375 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-c3b0d1f2-2bcc-4bc7-ac7e-ea19951bddba tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:35.175965 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-c3b0d1f2-2bcc-4bc7-ac7e-ea19951bddba tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:35.179682 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-1b0d7470-4079-4806-b449-260adfd46df1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:35.182154 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c3b0d1f2-2bcc-4bc7-ac7e-ea19951bddba tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:35.182636 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c3b0d1f2-2bcc-4bc7-ac7e-ea19951bddba tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:35.183065 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c3b0d1f2-2bcc-4bc7-ac7e-ea19951bddba tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:35.183755 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c3b0d1f2-2bcc-4bc7-ac7e-ea19951bddba tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:35.184207 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c3b0d1f2-2bcc-4bc7-ac7e-ea19951bddba tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:35.184634 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c3b0d1f2-2bcc-4bc7-ac7e-ea19951bddba tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:35.188698 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-1b0d7470-4079-4806-b449-260adfd46df1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:35.190336 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-1b0d7470-4079-4806-b449-260adfd46df1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:35.191496 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-1b0d7470-4079-4806-b449-260adfd46df1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.263152 Aug 09 11:20:35.196295 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 181/395] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:20:34 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 11:20:35.342369 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-c3b0d1f2-2bcc-4bc7-ac7e-ea19951bddba tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:35.360800 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-c3b0d1f2-2bcc-4bc7-ac7e-ea19951bddba tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.187532 Aug 09 11:20:35.361501 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 215/396] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:35 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:36.193677 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-e8986210-6670-48e0-aec8-40fbfbb55a44 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:36.194345 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-e8986210-6670-48e0-aec8-40fbfbb55a44 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:36.202429 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e8986210-6670-48e0-aec8-40fbfbb55a44 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:36.203028 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e8986210-6670-48e0-aec8-40fbfbb55a44 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:36.203457 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e8986210-6670-48e0-aec8-40fbfbb55a44 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:36.204232 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e8986210-6670-48e0-aec8-40fbfbb55a44 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:36.204886 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e8986210-6670-48e0-aec8-40fbfbb55a44 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:36.205309 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e8986210-6670-48e0-aec8-40fbfbb55a44 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:36.216145 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-f9c5f022-0a7f-41e7-91de-07ceaf9b24d3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:36.217579 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-f9c5f022-0a7f-41e7-91de-07ceaf9b24d3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:36.223557 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:36.225965 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f9c5f022-0a7f-41e7-91de-07ceaf9b24d3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:36.226682 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f9c5f022-0a7f-41e7-91de-07ceaf9b24d3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:36.227331 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f9c5f022-0a7f-41e7-91de-07ceaf9b24d3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:36.228280 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f9c5f022-0a7f-41e7-91de-07ceaf9b24d3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:36.228935 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f9c5f022-0a7f-41e7-91de-07ceaf9b24d3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:36.229574 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f9c5f022-0a7f-41e7-91de-07ceaf9b24d3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:36.432912 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-e8986210-6670-48e0-aec8-40fbfbb55a44 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:36.436741 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-f9c5f022-0a7f-41e7-91de-07ceaf9b24d3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:36.440611 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-e8986210-6670-48e0-aec8-40fbfbb55a44 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1261 microversion: 2.1 time: 0.252679 Aug 09 11:20:36.441174 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 182/397] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:36 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1261 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:36.445854 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-f9c5f022-0a7f-41e7-91de-07ceaf9b24d3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:36.446028 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-1b3c3834-a80f-46fc-8e22-62398162593a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:36.446461 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-1b3c3834-a80f-46fc-8e22-62398162593a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:36.447329 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-f9c5f022-0a7f-41e7-91de-07ceaf9b24d3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:36.448523 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-f9c5f022-0a7f-41e7-91de-07ceaf9b24d3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.237836 Aug 09 11:20:36.450345 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 216/398] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:20:36 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:20:36.452651 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1b3c3834-a80f-46fc-8e22-62398162593a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:36.453127 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1b3c3834-a80f-46fc-8e22-62398162593a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:36.453558 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1b3c3834-a80f-46fc-8e22-62398162593a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:36.454248 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1b3c3834-a80f-46fc-8e22-62398162593a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:36.454688 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1b3c3834-a80f-46fc-8e22-62398162593a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:36.455103 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1b3c3834-a80f-46fc-8e22-62398162593a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:36.591328 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-1b3c3834-a80f-46fc-8e22-62398162593a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:36.600672 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-1b3c3834-a80f-46fc-8e22-62398162593a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.158507 Aug 09 11:20:36.601248 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 183/399] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:36 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:37.463533 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-55225d0a-c1bb-483a-aac6-96692186bb55 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:37.464310 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-55225d0a-c1bb-483a-aac6-96692186bb55 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:37.471321 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-c28c5dd6-cb80-439e-9fe6-278168f0b70a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:37.472004 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-55225d0a-c1bb-483a-aac6-96692186bb55 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:37.472108 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-c28c5dd6-cb80-439e-9fe6-278168f0b70a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:37.472191 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-55225d0a-c1bb-483a-aac6-96692186bb55 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:37.472723 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-55225d0a-c1bb-483a-aac6-96692186bb55 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:37.473592 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-55225d0a-c1bb-483a-aac6-96692186bb55 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:37.474085 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-55225d0a-c1bb-483a-aac6-96692186bb55 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:37.474525 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-55225d0a-c1bb-483a-aac6-96692186bb55 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:37.478605 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c28c5dd6-cb80-439e-9fe6-278168f0b70a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:37.479076 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c28c5dd6-cb80-439e-9fe6-278168f0b70a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:37.479502 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c28c5dd6-cb80-439e-9fe6-278168f0b70a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:37.480228 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c28c5dd6-cb80-439e-9fe6-278168f0b70a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:37.480705 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c28c5dd6-cb80-439e-9fe6-278168f0b70a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:37.481116 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c28c5dd6-cb80-439e-9fe6-278168f0b70a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:37.704072 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-55225d0a-c1bb-483a-aac6-96692186bb55 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:37.710820 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-c28c5dd6-cb80-439e-9fe6-278168f0b70a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:37.714572 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:37.716948 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-55225d0a-c1bb-483a-aac6-96692186bb55 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1261 microversion: 2.1 time: 0.257983 Aug 09 11:20:37.720040 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 217/400] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:37 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1261 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:20:37.721317 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-c28c5dd6-cb80-439e-9fe6-278168f0b70a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:37.723241 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-c28c5dd6-cb80-439e-9fe6-278168f0b70a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:37.725207 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-c28c5dd6-cb80-439e-9fe6-278168f0b70a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.257885 Aug 09 11:20:37.740637 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-97bf38f5-0985-402c-952f-65e36d6e98f5 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:37.740637 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-97bf38f5-0985-402c-952f-65e36d6e98f5 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:37.740637 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-97bf38f5-0985-402c-952f-65e36d6e98f5 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:37.740637 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-97bf38f5-0985-402c-952f-65e36d6e98f5 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:37.741107 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-97bf38f5-0985-402c-952f-65e36d6e98f5 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:37.741107 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-97bf38f5-0985-402c-952f-65e36d6e98f5 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:37.741107 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-97bf38f5-0985-402c-952f-65e36d6e98f5 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:37.741107 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-97bf38f5-0985-402c-952f-65e36d6e98f5 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:37.741396 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 184/401] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:20:37 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:20:37.878260 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-97bf38f5-0985-402c-952f-65e36d6e98f5 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:37.887058 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-97bf38f5-0985-402c-952f-65e36d6e98f5 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.167868 Aug 09 11:20:37.887667 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 218/402] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:37 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:38.743329 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-63fe3ca2-1683-4e73-8a47-10bf98201da0 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:38.743329 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-63fe3ca2-1683-4e73-8a47-10bf98201da0 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:38.748532 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-8a92c5f8-9fe0-40d6-8e66-be63a63a1284 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:38.749129 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-8a92c5f8-9fe0-40d6-8e66-be63a63a1284 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:38.756633 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8a92c5f8-9fe0-40d6-8e66-be63a63a1284 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:38.757108 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8a92c5f8-9fe0-40d6-8e66-be63a63a1284 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:38.757534 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8a92c5f8-9fe0-40d6-8e66-be63a63a1284 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:38.758320 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8a92c5f8-9fe0-40d6-8e66-be63a63a1284 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:38.758597 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-63fe3ca2-1683-4e73-8a47-10bf98201da0 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:38.758750 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8a92c5f8-9fe0-40d6-8e66-be63a63a1284 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:38.759085 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-63fe3ca2-1683-4e73-8a47-10bf98201da0 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:38.759199 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8a92c5f8-9fe0-40d6-8e66-be63a63a1284 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:38.759516 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-63fe3ca2-1683-4e73-8a47-10bf98201da0 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:38.760211 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-63fe3ca2-1683-4e73-8a47-10bf98201da0 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:38.760687 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-63fe3ca2-1683-4e73-8a47-10bf98201da0 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:38.761106 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-63fe3ca2-1683-4e73-8a47-10bf98201da0 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:38.961772 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-8a92c5f8-9fe0-40d6-8e66-be63a63a1284 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:38.965500 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-63fe3ca2-1683-4e73-8a47-10bf98201da0 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:38.973838 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-63fe3ca2-1683-4e73-8a47-10bf98201da0 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1261 microversion: 2.1 time: 0.239086 Aug 09 11:20:38.974604 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 185/403] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:38 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1261 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:38.974817 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-8a92c5f8-9fe0-40d6-8e66-be63a63a1284 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:38.978976 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-5db29da9-9c34-4bc1-b9d2-81b76e5c1e0f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:38.979624 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-5db29da9-9c34-4bc1-b9d2-81b76e5c1e0f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:38.986170 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-8a92c5f8-9fe0-40d6-8e66-be63a63a1284 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:38.987383 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-8a92c5f8-9fe0-40d6-8e66-be63a63a1284 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.242862 Aug 09 11:20:38.988543 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 219/404] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:20:38 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:20:38.991637 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5db29da9-9c34-4bc1-b9d2-81b76e5c1e0f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:38.992211 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5db29da9-9c34-4bc1-b9d2-81b76e5c1e0f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:38.992682 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5db29da9-9c34-4bc1-b9d2-81b76e5c1e0f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:38.993440 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5db29da9-9c34-4bc1-b9d2-81b76e5c1e0f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:38.993834 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5db29da9-9c34-4bc1-b9d2-81b76e5c1e0f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:38.994254 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5db29da9-9c34-4bc1-b9d2-81b76e5c1e0f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:39.162201 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-5db29da9-9c34-4bc1-b9d2-81b76e5c1e0f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:39.173821 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-5db29da9-9c34-4bc1-b9d2-81b76e5c1e0f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.198357 Aug 09 11:20:39.174782 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 186/405] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:38 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:39.998210 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-1dd4829d-0cad-45b6-88a7-bdbee16d69a4 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:39.999156 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-1dd4829d-0cad-45b6-88a7-bdbee16d69a4 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:40.012578 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1dd4829d-0cad-45b6-88a7-bdbee16d69a4 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:40.013452 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1dd4829d-0cad-45b6-88a7-bdbee16d69a4 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:40.014275 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1dd4829d-0cad-45b6-88a7-bdbee16d69a4 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:40.015852 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1dd4829d-0cad-45b6-88a7-bdbee16d69a4 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:40.016716 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1dd4829d-0cad-45b6-88a7-bdbee16d69a4 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:40.017507 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1dd4829d-0cad-45b6-88a7-bdbee16d69a4 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:40.018617 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-0142130b-3925-4476-b7f2-c2fc8594976e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:40.019545 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-0142130b-3925-4476-b7f2-c2fc8594976e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:40.027206 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0142130b-3925-4476-b7f2-c2fc8594976e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:40.027706 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0142130b-3925-4476-b7f2-c2fc8594976e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:40.028134 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0142130b-3925-4476-b7f2-c2fc8594976e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:40.028867 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0142130b-3925-4476-b7f2-c2fc8594976e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:40.029307 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0142130b-3925-4476-b7f2-c2fc8594976e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:40.029719 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0142130b-3925-4476-b7f2-c2fc8594976e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:40.446300 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-1dd4829d-0cad-45b6-88a7-bdbee16d69a4 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:40.449548 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-0142130b-3925-4476-b7f2-c2fc8594976e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:40.453948 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-1dd4829d-0cad-45b6-88a7-bdbee16d69a4 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1261 microversion: 2.1 time: 0.461917 Aug 09 11:20:40.454518 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 220/406] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:39 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1261 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:40.458769 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-0142130b-3925-4476-b7f2-c2fc8594976e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:40.459070 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-8ecde6f7-9d5e-46f7-8c97-b8ef568ea781 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:40.459696 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-8ecde6f7-9d5e-46f7-8c97-b8ef568ea781 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:40.460301 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-0142130b-3925-4476-b7f2-c2fc8594976e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:40.461511 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-0142130b-3925-4476-b7f2-c2fc8594976e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.449260 Aug 09 11:20:40.462277 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 187/407] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:20:40 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:20:40.465496 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8ecde6f7-9d5e-46f7-8c97-b8ef568ea781 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:40.465967 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8ecde6f7-9d5e-46f7-8c97-b8ef568ea781 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:40.466392 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8ecde6f7-9d5e-46f7-8c97-b8ef568ea781 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:40.467058 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8ecde6f7-9d5e-46f7-8c97-b8ef568ea781 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:40.467498 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8ecde6f7-9d5e-46f7-8c97-b8ef568ea781 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:40.467904 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8ecde6f7-9d5e-46f7-8c97-b8ef568ea781 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:40.603622 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-8ecde6f7-9d5e-46f7-8c97-b8ef568ea781 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:40.616572 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-8ecde6f7-9d5e-46f7-8c97-b8ef568ea781 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.160827 Aug 09 11:20:40.617312 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 221/408] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:40 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:41.478367 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-f1ae4bb2-c732-4635-abf1-4e3f2ac0efd3 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:41.479219 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-f1ae4bb2-c732-4635-abf1-4e3f2ac0efd3 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:41.487999 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-53cc9a9b-909e-49e5-92d2-82a1220150f6 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:41.489162 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-53cc9a9b-909e-49e5-92d2-82a1220150f6 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:41.490036 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f1ae4bb2-c732-4635-abf1-4e3f2ac0efd3 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:41.490633 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f1ae4bb2-c732-4635-abf1-4e3f2ac0efd3 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:41.491056 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f1ae4bb2-c732-4635-abf1-4e3f2ac0efd3 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:41.491751 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f1ae4bb2-c732-4635-abf1-4e3f2ac0efd3 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:41.492198 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f1ae4bb2-c732-4635-abf1-4e3f2ac0efd3 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:41.492644 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f1ae4bb2-c732-4635-abf1-4e3f2ac0efd3 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:41.496142 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-53cc9a9b-909e-49e5-92d2-82a1220150f6 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:41.496656 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-53cc9a9b-909e-49e5-92d2-82a1220150f6 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:41.497084 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-53cc9a9b-909e-49e5-92d2-82a1220150f6 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:41.497770 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-53cc9a9b-909e-49e5-92d2-82a1220150f6 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:41.498209 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-53cc9a9b-909e-49e5-92d2-82a1220150f6 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:41.498620 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-53cc9a9b-909e-49e5-92d2-82a1220150f6 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:41.692182 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-f1ae4bb2-c732-4635-abf1-4e3f2ac0efd3 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:41.695774 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-53cc9a9b-909e-49e5-92d2-82a1220150f6 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:41.700489 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-f1ae4bb2-c732-4635-abf1-4e3f2ac0efd3 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1261 microversion: 2.1 time: 0.228750 Aug 09 11:20:41.701274 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 188/409] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:41 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1261 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:41.704811 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-53cc9a9b-909e-49e5-92d2-82a1220150f6 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:41.705430 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-cda74741-9ca0-4945-82ae-6776ba58a76e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:41.706001 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-cda74741-9ca0-4945-82ae-6776ba58a76e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:41.706653 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-53cc9a9b-909e-49e5-92d2-82a1220150f6 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:41.708085 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-53cc9a9b-909e-49e5-92d2-82a1220150f6 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.226371 Aug 09 11:20:41.710993 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 222/410] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:20:41 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:20:41.712423 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cda74741-9ca0-4945-82ae-6776ba58a76e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:41.712931 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cda74741-9ca0-4945-82ae-6776ba58a76e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:41.713355 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cda74741-9ca0-4945-82ae-6776ba58a76e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:41.714043 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cda74741-9ca0-4945-82ae-6776ba58a76e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:41.714490 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cda74741-9ca0-4945-82ae-6776ba58a76e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:41.714890 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cda74741-9ca0-4945-82ae-6776ba58a76e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:41.850682 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-cda74741-9ca0-4945-82ae-6776ba58a76e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:41.861561 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-cda74741-9ca0-4945-82ae-6776ba58a76e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.159273 Aug 09 11:20:41.862464 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 189/411] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:41 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:42.725316 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-ee1409e1-cdf1-4756-baf7-b3f9a70f1e71 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:42.725976 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-ee1409e1-cdf1-4756-baf7-b3f9a70f1e71 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:42.730935 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-f14708bc-28b1-4d42-bf3a-1d1d483d6c40 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:42.731537 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-f14708bc-28b1-4d42-bf3a-1d1d483d6c40 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:42.732822 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ee1409e1-cdf1-4756-baf7-b3f9a70f1e71 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:42.733482 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ee1409e1-cdf1-4756-baf7-b3f9a70f1e71 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:42.733913 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ee1409e1-cdf1-4756-baf7-b3f9a70f1e71 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:42.734594 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ee1409e1-cdf1-4756-baf7-b3f9a70f1e71 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:42.735029 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ee1409e1-cdf1-4756-baf7-b3f9a70f1e71 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:42.735439 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ee1409e1-cdf1-4756-baf7-b3f9a70f1e71 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:42.737856 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f14708bc-28b1-4d42-bf3a-1d1d483d6c40 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:42.738336 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f14708bc-28b1-4d42-bf3a-1d1d483d6c40 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:42.739638 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f14708bc-28b1-4d42-bf3a-1d1d483d6c40 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:42.740205 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f14708bc-28b1-4d42-bf3a-1d1d483d6c40 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:42.740699 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f14708bc-28b1-4d42-bf3a-1d1d483d6c40 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:42.741115 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f14708bc-28b1-4d42-bf3a-1d1d483d6c40 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:42.929482 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-ee1409e1-cdf1-4756-baf7-b3f9a70f1e71 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:42.931927 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-f14708bc-28b1-4d42-bf3a-1d1d483d6c40 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:42.937283 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-ee1409e1-cdf1-4756-baf7-b3f9a70f1e71 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1261 microversion: 2.1 time: 0.218112 Aug 09 11:20:42.938023 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 223/412] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:42 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1261 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:42.940904 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-f14708bc-28b1-4d42-bf3a-1d1d483d6c40 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:42.942406 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-f14708bc-28b1-4d42-bf3a-1d1d483d6c40 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:42.942981 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-01971d9c-2653-4a32-b03e-f68cad5d7b65 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:42.943681 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-01971d9c-2653-4a32-b03e-f68cad5d7b65 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:42.943820 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-f14708bc-28b1-4d42-bf3a-1d1d483d6c40 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.216794 Aug 09 11:20:42.952792 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 190/413] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:20:42 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:20:42.952992 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-01971d9c-2653-4a32-b03e-f68cad5d7b65 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:42.952992 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-01971d9c-2653-4a32-b03e-f68cad5d7b65 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:42.952992 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-01971d9c-2653-4a32-b03e-f68cad5d7b65 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:42.952992 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-01971d9c-2653-4a32-b03e-f68cad5d7b65 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:42.953463 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-01971d9c-2653-4a32-b03e-f68cad5d7b65 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:42.953463 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-01971d9c-2653-4a32-b03e-f68cad5d7b65 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:43.086773 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-01971d9c-2653-4a32-b03e-f68cad5d7b65 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:43.094374 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-01971d9c-2653-4a32-b03e-f68cad5d7b65 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.155349 Aug 09 11:20:43.094900 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 224/414] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:42 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:43.961246 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-f3912c14-9875-4d81-8467-e2efa664c18b tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:43.961950 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-f3912c14-9875-4d81-8467-e2efa664c18b tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:43.966944 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-4ad20126-9777-4efb-abcd-e82e9d8a3622 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:43.967595 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-4ad20126-9777-4efb-abcd-e82e9d8a3622 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:43.969198 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f3912c14-9875-4d81-8467-e2efa664c18b tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:43.969742 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f3912c14-9875-4d81-8467-e2efa664c18b tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:43.970181 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f3912c14-9875-4d81-8467-e2efa664c18b tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:43.970901 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f3912c14-9875-4d81-8467-e2efa664c18b tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:43.971337 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f3912c14-9875-4d81-8467-e2efa664c18b tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:43.971787 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f3912c14-9875-4d81-8467-e2efa664c18b tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:43.974236 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4ad20126-9777-4efb-abcd-e82e9d8a3622 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:43.974789 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4ad20126-9777-4efb-abcd-e82e9d8a3622 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:43.975142 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4ad20126-9777-4efb-abcd-e82e9d8a3622 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:43.975827 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4ad20126-9777-4efb-abcd-e82e9d8a3622 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:43.976279 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4ad20126-9777-4efb-abcd-e82e9d8a3622 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:43.976709 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4ad20126-9777-4efb-abcd-e82e9d8a3622 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:44.187031 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-f3912c14-9875-4d81-8467-e2efa664c18b tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:44.191694 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-4ad20126-9777-4efb-abcd-e82e9d8a3622 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:44.196803 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-f3912c14-9875-4d81-8467-e2efa664c18b tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1261 microversion: 2.1 time: 0.240810 Aug 09 11:20:44.197608 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 191/415] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:43 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1261 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:44.201230 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-4ad20126-9777-4efb-abcd-e82e9d8a3622 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:44.202745 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-7b725980-bd66-460f-a40b-e4d96dc98967 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:44.202902 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-4ad20126-9777-4efb-abcd-e82e9d8a3622 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:44.203337 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-7b725980-bd66-460f-a40b-e4d96dc98967 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:44.204102 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-4ad20126-9777-4efb-abcd-e82e9d8a3622 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.241064 Aug 09 11:20:44.205090 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 225/416] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:20:43 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:20:44.209669 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7b725980-bd66-460f-a40b-e4d96dc98967 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:44.210135 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7b725980-bd66-460f-a40b-e4d96dc98967 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:44.210576 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7b725980-bd66-460f-a40b-e4d96dc98967 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:44.211258 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7b725980-bd66-460f-a40b-e4d96dc98967 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:44.211693 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7b725980-bd66-460f-a40b-e4d96dc98967 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:44.212104 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7b725980-bd66-460f-a40b-e4d96dc98967 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:44.343998 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-7b725980-bd66-460f-a40b-e4d96dc98967 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:44.351956 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-7b725980-bd66-460f-a40b-e4d96dc98967 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.152765 Aug 09 11:20:44.352714 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 192/417] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:44 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:45.218214 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-49fb03e1-9da1-47f5-bffa-0ee5e0c81268 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:45.218788 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-49fb03e1-9da1-47f5-bffa-0ee5e0c81268 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:45.225772 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-49fb03e1-9da1-47f5-bffa-0ee5e0c81268 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:45.226255 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-49fb03e1-9da1-47f5-bffa-0ee5e0c81268 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:45.226685 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-49fb03e1-9da1-47f5-bffa-0ee5e0c81268 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:45.227387 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-49fb03e1-9da1-47f5-bffa-0ee5e0c81268 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:45.227651 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-9ca840ef-1fb5-4465-86ef-0910cff20c9d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:45.228075 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-49fb03e1-9da1-47f5-bffa-0ee5e0c81268 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:45.228228 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-49fb03e1-9da1-47f5-bffa-0ee5e0c81268 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:45.228407 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-9ca840ef-1fb5-4465-86ef-0910cff20c9d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:45.235535 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9ca840ef-1fb5-4465-86ef-0910cff20c9d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:45.236018 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9ca840ef-1fb5-4465-86ef-0910cff20c9d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:45.236483 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9ca840ef-1fb5-4465-86ef-0910cff20c9d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:45.237182 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9ca840ef-1fb5-4465-86ef-0910cff20c9d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:45.237633 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9ca840ef-1fb5-4465-86ef-0910cff20c9d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:45.238054 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9ca840ef-1fb5-4465-86ef-0910cff20c9d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:45.433023 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-49fb03e1-9da1-47f5-bffa-0ee5e0c81268 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:45.436098 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-9ca840ef-1fb5-4465-86ef-0910cff20c9d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:45.441500 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-49fb03e1-9da1-47f5-bffa-0ee5e0c81268 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1261 microversion: 2.1 time: 0.227316 Aug 09 11:20:45.442525 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 226/418] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:45 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1261 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:45.445582 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-9ca840ef-1fb5-4465-86ef-0910cff20c9d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:45.447097 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-9ca840ef-1fb5-4465-86ef-0910cff20c9d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:45.448367 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-0b3b0a5b-2007-4ce8-b5a2-9166c9339861 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:45.448508 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-9ca840ef-1fb5-4465-86ef-0910cff20c9d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.225116 Aug 09 11:20:45.449308 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-0b3b0a5b-2007-4ce8-b5a2-9166c9339861 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:45.455576 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0b3b0a5b-2007-4ce8-b5a2-9166c9339861 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:45.456067 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0b3b0a5b-2007-4ce8-b5a2-9166c9339861 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:45.456650 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0b3b0a5b-2007-4ce8-b5a2-9166c9339861 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:45.457540 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0b3b0a5b-2007-4ce8-b5a2-9166c9339861 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:45.458283 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0b3b0a5b-2007-4ce8-b5a2-9166c9339861 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:45.458878 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0b3b0a5b-2007-4ce8-b5a2-9166c9339861 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:45.460824 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 193/419] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:20:45 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:20:45.610135 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-0b3b0a5b-2007-4ce8-b5a2-9166c9339861 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:45.621352 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-0b3b0a5b-2007-4ce8-b5a2-9166c9339861 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.177186 Aug 09 11:20:45.622098 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 227/420] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:45 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:46.466692 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-7f70cee8-95f3-4aea-9ac4-8ca62913b72e tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:46.467680 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-7f70cee8-95f3-4aea-9ac4-8ca62913b72e tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:46.475383 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-ff04219f-454e-4268-b8f8-9fd405436ca3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:46.476166 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-ff04219f-454e-4268-b8f8-9fd405436ca3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:46.477111 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7f70cee8-95f3-4aea-9ac4-8ca62913b72e tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:46.477604 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7f70cee8-95f3-4aea-9ac4-8ca62913b72e tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:46.478023 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7f70cee8-95f3-4aea-9ac4-8ca62913b72e tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:46.479038 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7f70cee8-95f3-4aea-9ac4-8ca62913b72e tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:46.479152 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7f70cee8-95f3-4aea-9ac4-8ca62913b72e tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:46.479642 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7f70cee8-95f3-4aea-9ac4-8ca62913b72e tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:46.482380 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ff04219f-454e-4268-b8f8-9fd405436ca3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:46.482856 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ff04219f-454e-4268-b8f8-9fd405436ca3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:46.483279 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ff04219f-454e-4268-b8f8-9fd405436ca3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:46.483986 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ff04219f-454e-4268-b8f8-9fd405436ca3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:46.484461 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ff04219f-454e-4268-b8f8-9fd405436ca3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:46.484860 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ff04219f-454e-4268-b8f8-9fd405436ca3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:46.677965 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-ff04219f-454e-4268-b8f8-9fd405436ca3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:46.681496 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell1:SELECT=100 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:46.681659 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-7f70cee8-95f3-4aea-9ac4-8ca62913b72e tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:46.687432 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-ff04219f-454e-4268-b8f8-9fd405436ca3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:46.688922 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-ff04219f-454e-4268-b8f8-9fd405436ca3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:46.689273 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-7f70cee8-95f3-4aea-9ac4-8ca62913b72e tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1261 microversion: 2.1 time: 0.229348 Aug 09 11:20:46.689860 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 194/421] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:46 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1261 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:46.690068 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-ff04219f-454e-4268-b8f8-9fd405436ca3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.221123 Aug 09 11:20:46.696021 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 228/422] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:20:46 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:20:46.696190 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-54eab6e6-d0fa-4f8a-a0f5-02f9899d1345 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:46.696190 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-54eab6e6-d0fa-4f8a-a0f5-02f9899d1345 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:46.700691 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-54eab6e6-d0fa-4f8a-a0f5-02f9899d1345 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:46.701176 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-54eab6e6-d0fa-4f8a-a0f5-02f9899d1345 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:46.701605 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-54eab6e6-d0fa-4f8a-a0f5-02f9899d1345 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:46.702299 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-54eab6e6-d0fa-4f8a-a0f5-02f9899d1345 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:46.702749 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-54eab6e6-d0fa-4f8a-a0f5-02f9899d1345 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:46.703173 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-54eab6e6-d0fa-4f8a-a0f5-02f9899d1345 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:46.840291 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-54eab6e6-d0fa-4f8a-a0f5-02f9899d1345 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:46.847954 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-54eab6e6-d0fa-4f8a-a0f5-02f9899d1345 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.157130 Aug 09 11:20:46.848549 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 195/423] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:46 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:47.713633 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-da3e7301-7158-40c5-b5aa-e0cbf3346071 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:47.714663 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-da3e7301-7158-40c5-b5aa-e0cbf3346071 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:47.717091 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-fb106de9-6d1b-4837-a268-211eaf0c292a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:47.718053 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-fb106de9-6d1b-4837-a268-211eaf0c292a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:47.725709 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-da3e7301-7158-40c5-b5aa-e0cbf3346071 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:47.726186 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-da3e7301-7158-40c5-b5aa-e0cbf3346071 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:47.726763 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-da3e7301-7158-40c5-b5aa-e0cbf3346071 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:47.727324 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-fb106de9-6d1b-4837-a268-211eaf0c292a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:47.727479 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-da3e7301-7158-40c5-b5aa-e0cbf3346071 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:47.727815 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-fb106de9-6d1b-4837-a268-211eaf0c292a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:47.727963 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-da3e7301-7158-40c5-b5aa-e0cbf3346071 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:47.728249 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-fb106de9-6d1b-4837-a268-211eaf0c292a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:47.728429 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-da3e7301-7158-40c5-b5aa-e0cbf3346071 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:47.728995 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-fb106de9-6d1b-4837-a268-211eaf0c292a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:47.729448 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-fb106de9-6d1b-4837-a268-211eaf0c292a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:47.729873 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-fb106de9-6d1b-4837-a268-211eaf0c292a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:47.945619 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-fb106de9-6d1b-4837-a268-211eaf0c292a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:47.949308 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-da3e7301-7158-40c5-b5aa-e0cbf3346071 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:47.954603 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-fb106de9-6d1b-4837-a268-211eaf0c292a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:47.956122 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-fb106de9-6d1b-4837-a268-211eaf0c292a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:47.957289 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-fb106de9-6d1b-4837-a268-211eaf0c292a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.247119 Aug 09 11:20:47.957625 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-da3e7301-7158-40c5-b5aa-e0cbf3346071 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1261 microversion: 2.1 time: 0.249779 Aug 09 11:20:47.962830 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 196/424] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:20:47 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:20:47.962830 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-43b8fd7e-9d0c-4884-9a10-fe5c886e8118 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:47.963071 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 229/425] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:47 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1261 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:47.963166 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-43b8fd7e-9d0c-4884-9a10-fe5c886e8118 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:47.969144 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-43b8fd7e-9d0c-4884-9a10-fe5c886e8118 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:47.969621 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-43b8fd7e-9d0c-4884-9a10-fe5c886e8118 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:47.970043 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-43b8fd7e-9d0c-4884-9a10-fe5c886e8118 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:47.970713 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-43b8fd7e-9d0c-4884-9a10-fe5c886e8118 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:47.971139 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-43b8fd7e-9d0c-4884-9a10-fe5c886e8118 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:47.971572 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-43b8fd7e-9d0c-4884-9a10-fe5c886e8118 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:48.119188 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-43b8fd7e-9d0c-4884-9a10-fe5c886e8118 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:48.127747 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-43b8fd7e-9d0c-4884-9a10-fe5c886e8118 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.168760 Aug 09 11:20:48.128344 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 197/426] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:47 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:48.977662 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-035fea92-aa0b-4e51-8abc-e5cc1a93d49c tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:48.978255 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-035fea92-aa0b-4e51-8abc-e5cc1a93d49c tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:48.980899 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-e4a79d77-727b-4c86-8be1-6b2a05bd9038 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:48.981533 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-e4a79d77-727b-4c86-8be1-6b2a05bd9038 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:48.985271 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-035fea92-aa0b-4e51-8abc-e5cc1a93d49c tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:48.985753 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-035fea92-aa0b-4e51-8abc-e5cc1a93d49c tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:48.986160 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-035fea92-aa0b-4e51-8abc-e5cc1a93d49c tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:48.986853 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-035fea92-aa0b-4e51-8abc-e5cc1a93d49c tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:48.987300 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-035fea92-aa0b-4e51-8abc-e5cc1a93d49c tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:48.987709 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-035fea92-aa0b-4e51-8abc-e5cc1a93d49c tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:48.988178 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e4a79d77-727b-4c86-8be1-6b2a05bd9038 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:48.988704 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e4a79d77-727b-4c86-8be1-6b2a05bd9038 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:48.989133 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e4a79d77-727b-4c86-8be1-6b2a05bd9038 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:48.989828 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e4a79d77-727b-4c86-8be1-6b2a05bd9038 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:48.990485 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e4a79d77-727b-4c86-8be1-6b2a05bd9038 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:48.991040 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e4a79d77-727b-4c86-8be1-6b2a05bd9038 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:49.195796 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-035fea92-aa0b-4e51-8abc-e5cc1a93d49c tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:49.199175 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-e4a79d77-727b-4c86-8be1-6b2a05bd9038 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:49.203883 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-035fea92-aa0b-4e51-8abc-e5cc1a93d49c tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1261 microversion: 2.1 time: 0.230175 Aug 09 11:20:49.204503 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 230/427] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:48 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1261 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:49.208118 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-e4a79d77-727b-4c86-8be1-6b2a05bd9038 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:49.209120 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-00c35729-04d9-4274-8288-0ab3708c9f31 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:49.209693 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-00c35729-04d9-4274-8288-0ab3708c9f31 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:49.210151 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-e4a79d77-727b-4c86-8be1-6b2a05bd9038 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:49.211396 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-e4a79d77-727b-4c86-8be1-6b2a05bd9038 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.234376 Aug 09 11:20:49.212043 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 198/428] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:20:48 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:20:49.215660 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-00c35729-04d9-4274-8288-0ab3708c9f31 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:49.216472 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-00c35729-04d9-4274-8288-0ab3708c9f31 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:49.216910 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-00c35729-04d9-4274-8288-0ab3708c9f31 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:49.217606 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-00c35729-04d9-4274-8288-0ab3708c9f31 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:49.218055 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-00c35729-04d9-4274-8288-0ab3708c9f31 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:49.218476 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-00c35729-04d9-4274-8288-0ab3708c9f31 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:49.350907 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-00c35729-04d9-4274-8288-0ab3708c9f31 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:49.358846 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-00c35729-04d9-4274-8288-0ab3708c9f31 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.153296 Aug 09 11:20:49.359434 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 231/429] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:49 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:50.228071 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-4852dc66-27f6-44e3-93af-174634eb1a92 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:50.228703 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-4852dc66-27f6-44e3-93af-174634eb1a92 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:50.234309 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-6b3a9151-5866-47c9-9beb-5c44f6c9f161 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:50.234917 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-6b3a9151-5866-47c9-9beb-5c44f6c9f161 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:50.235666 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4852dc66-27f6-44e3-93af-174634eb1a92 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:50.236180 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4852dc66-27f6-44e3-93af-174634eb1a92 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:50.236665 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4852dc66-27f6-44e3-93af-174634eb1a92 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:50.237358 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4852dc66-27f6-44e3-93af-174634eb1a92 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:50.237812 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4852dc66-27f6-44e3-93af-174634eb1a92 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:50.238223 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4852dc66-27f6-44e3-93af-174634eb1a92 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:50.241815 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6b3a9151-5866-47c9-9beb-5c44f6c9f161 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:50.242294 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6b3a9151-5866-47c9-9beb-5c44f6c9f161 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:50.242735 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6b3a9151-5866-47c9-9beb-5c44f6c9f161 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:50.243422 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6b3a9151-5866-47c9-9beb-5c44f6c9f161 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:50.243851 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6b3a9151-5866-47c9-9beb-5c44f6c9f161 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:50.244295 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6b3a9151-5866-47c9-9beb-5c44f6c9f161 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:50.440187 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-4852dc66-27f6-44e3-93af-174634eb1a92 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:50.444565 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-6b3a9151-5866-47c9-9beb-5c44f6c9f161 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:50.448085 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-4852dc66-27f6-44e3-93af-174634eb1a92 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1261 microversion: 2.1 time: 0.225646 Aug 09 11:20:50.448701 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 199/430] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:50 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1261 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:50.453134 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-ada8e86e-9947-4d51-b28d-e17b97fd410f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:50.453728 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-ada8e86e-9947-4d51-b28d-e17b97fd410f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:50.454796 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-6b3a9151-5866-47c9-9beb-5c44f6c9f161 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:50.456291 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-6b3a9151-5866-47c9-9beb-5c44f6c9f161 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:50.457492 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-6b3a9151-5866-47c9-9beb-5c44f6c9f161 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.227050 Aug 09 11:20:50.460370 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ada8e86e-9947-4d51-b28d-e17b97fd410f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:50.460860 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ada8e86e-9947-4d51-b28d-e17b97fd410f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:50.461284 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ada8e86e-9947-4d51-b28d-e17b97fd410f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:50.461973 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ada8e86e-9947-4d51-b28d-e17b97fd410f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:50.462423 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ada8e86e-9947-4d51-b28d-e17b97fd410f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:50.462836 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ada8e86e-9947-4d51-b28d-e17b97fd410f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:50.467025 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 232/431] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:20:50 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:20:50.593548 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-ada8e86e-9947-4d51-b28d-e17b97fd410f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:50.605721 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-ada8e86e-9947-4d51-b28d-e17b97fd410f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.155768 Aug 09 11:20:50.606381 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 200/432] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:50 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:51.470994 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-58087e80-1272-4aae-873d-ce2356d84681 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:51.471552 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-58087e80-1272-4aae-873d-ce2356d84681 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:51.479448 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-58087e80-1272-4aae-873d-ce2356d84681 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:51.479933 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-58087e80-1272-4aae-873d-ce2356d84681 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:51.480359 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-58087e80-1272-4aae-873d-ce2356d84681 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:51.481080 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-58087e80-1272-4aae-873d-ce2356d84681 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:51.481522 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-58087e80-1272-4aae-873d-ce2356d84681 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:51.481935 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-58087e80-1272-4aae-873d-ce2356d84681 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:51.488594 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-9ee9d472-7f35-4e1d-9c65-4189c326e741 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:51.489185 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-9ee9d472-7f35-4e1d-9c65-4189c326e741 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:51.497282 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9ee9d472-7f35-4e1d-9c65-4189c326e741 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:51.497911 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9ee9d472-7f35-4e1d-9c65-4189c326e741 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:51.498346 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9ee9d472-7f35-4e1d-9c65-4189c326e741 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:51.499091 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9ee9d472-7f35-4e1d-9c65-4189c326e741 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:51.499539 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9ee9d472-7f35-4e1d-9c65-4189c326e741 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:51.499928 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9ee9d472-7f35-4e1d-9c65-4189c326e741 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:51.519779 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell1:SELECT=100 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:51.672832 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-58087e80-1272-4aae-873d-ce2356d84681 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:51.680694 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-58087e80-1272-4aae-873d-ce2356d84681 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1261 microversion: 2.1 time: 0.215660 Aug 09 11:20:51.681282 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 233/433] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:51 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1261 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:51.685747 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-b0a2c5c9-0468-4e93-a464-7b5e4592bcc9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:51.686336 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-b0a2c5c9-0468-4e93-a464-7b5e4592bcc9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:51.692260 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b0a2c5c9-0468-4e93-a464-7b5e4592bcc9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:51.692786 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b0a2c5c9-0468-4e93-a464-7b5e4592bcc9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:51.693219 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b0a2c5c9-0468-4e93-a464-7b5e4592bcc9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:51.693960 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b0a2c5c9-0468-4e93-a464-7b5e4592bcc9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:51.694408 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b0a2c5c9-0468-4e93-a464-7b5e4592bcc9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:51.694821 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b0a2c5c9-0468-4e93-a464-7b5e4592bcc9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:51.697164 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-9ee9d472-7f35-4e1d-9c65-4189c326e741 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:51.705848 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-9ee9d472-7f35-4e1d-9c65-4189c326e741 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:51.707789 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-9ee9d472-7f35-4e1d-9c65-4189c326e741 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:51.709026 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-9ee9d472-7f35-4e1d-9c65-4189c326e741 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.232501 Aug 09 11:20:51.709924 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 201/434] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:20:51 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:20:51.829863 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-b0a2c5c9-0468-4e93-a464-7b5e4592bcc9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:51.838150 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-b0a2c5c9-0468-4e93-a464-7b5e4592bcc9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.155894 Aug 09 11:20:51.838801 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 234/435] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:51 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:52.706081 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-d3391583-f92a-49cd-9904-7962e4d982e9 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:52.706951 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-d3391583-f92a-49cd-9904-7962e4d982e9 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:52.715387 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d3391583-f92a-49cd-9904-7962e4d982e9 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:52.715862 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d3391583-f92a-49cd-9904-7962e4d982e9 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:52.716300 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d3391583-f92a-49cd-9904-7962e4d982e9 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:52.717322 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d3391583-f92a-49cd-9904-7962e4d982e9 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:52.717793 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d3391583-f92a-49cd-9904-7962e4d982e9 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:52.718207 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d3391583-f92a-49cd-9904-7962e4d982e9 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:52.732042 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-85902a4a-8dbe-4d38-92ce-24141069a7ae tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:52.732857 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-85902a4a-8dbe-4d38-92ce-24141069a7ae tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:52.739793 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-85902a4a-8dbe-4d38-92ce-24141069a7ae tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:52.740317 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-85902a4a-8dbe-4d38-92ce-24141069a7ae tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:52.740736 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-85902a4a-8dbe-4d38-92ce-24141069a7ae tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:52.741410 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-85902a4a-8dbe-4d38-92ce-24141069a7ae tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:52.742190 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-85902a4a-8dbe-4d38-92ce-24141069a7ae tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:52.742342 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-85902a4a-8dbe-4d38-92ce-24141069a7ae tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:52.928769 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-d3391583-f92a-49cd-9904-7962e4d982e9 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:52.933333 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-85902a4a-8dbe-4d38-92ce-24141069a7ae tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:52.937423 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-d3391583-f92a-49cd-9904-7962e4d982e9 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1261 microversion: 2.1 time: 0.238403 Aug 09 11:20:52.938015 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 202/436] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:52 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1261 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:52.942475 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-85902a4a-8dbe-4d38-92ce-24141069a7ae tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:52.943103 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-c1ea538f-8cf3-4130-b7a6-1a7f480ad882 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:52.943697 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-c1ea538f-8cf3-4130-b7a6-1a7f480ad882 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:52.943981 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-85902a4a-8dbe-4d38-92ce-24141069a7ae tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:52.945200 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-85902a4a-8dbe-4d38-92ce-24141069a7ae tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.217124 Aug 09 11:20:52.945911 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 235/437] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:20:52 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:20:52.951166 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c1ea538f-8cf3-4130-b7a6-1a7f480ad882 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:52.951658 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c1ea538f-8cf3-4130-b7a6-1a7f480ad882 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:52.952064 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c1ea538f-8cf3-4130-b7a6-1a7f480ad882 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:52.952787 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c1ea538f-8cf3-4130-b7a6-1a7f480ad882 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:52.953228 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c1ea538f-8cf3-4130-b7a6-1a7f480ad882 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:52.953643 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c1ea538f-8cf3-4130-b7a6-1a7f480ad882 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:53.104651 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-c1ea538f-8cf3-4130-b7a6-1a7f480ad882 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:53.113217 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-c1ea538f-8cf3-4130-b7a6-1a7f480ad882 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.173074 Aug 09 11:20:53.113862 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 203/438] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:52 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:53.958804 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-95641cf4-1439-46a0-883f-d87be4477462 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:53.959416 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-95641cf4-1439-46a0-883f-d87be4477462 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:53.966600 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-95641cf4-1439-46a0-883f-d87be4477462 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:53.967068 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-95641cf4-1439-46a0-883f-d87be4477462 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:53.967514 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-95641cf4-1439-46a0-883f-d87be4477462 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:53.968209 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-95641cf4-1439-46a0-883f-d87be4477462 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:53.968690 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-95641cf4-1439-46a0-883f-d87be4477462 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:53.969107 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-95641cf4-1439-46a0-883f-d87be4477462 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:53.971251 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-881f15ca-fa80-4c16-b3aa-967acf9e41db tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:53.972094 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-881f15ca-fa80-4c16-b3aa-967acf9e41db tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:53.982058 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-881f15ca-fa80-4c16-b3aa-967acf9e41db tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:53.982610 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-881f15ca-fa80-4c16-b3aa-967acf9e41db tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:53.983218 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-881f15ca-fa80-4c16-b3aa-967acf9e41db tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:53.983992 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-881f15ca-fa80-4c16-b3aa-967acf9e41db tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:53.984570 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-881f15ca-fa80-4c16-b3aa-967acf9e41db tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:53.985046 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-881f15ca-fa80-4c16-b3aa-967acf9e41db tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:54.183450 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-95641cf4-1439-46a0-883f-d87be4477462 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:54.186577 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-881f15ca-fa80-4c16-b3aa-967acf9e41db tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:54.191155 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-95641cf4-1439-46a0-883f-d87be4477462 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1261 microversion: 2.1 time: 0.236151 Aug 09 11:20:54.191788 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 236/439] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:53 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1261 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:54.195915 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-881f15ca-fa80-4c16-b3aa-967acf9e41db tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:54.197449 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-881f15ca-fa80-4c16-b3aa-967acf9e41db tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:54.197771 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-76c8a489-d8f4-40db-bf88-cf4f786b9de1 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:54.198605 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-881f15ca-fa80-4c16-b3aa-967acf9e41db tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.232560 Aug 09 11:20:54.198839 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-76c8a489-d8f4-40db-bf88-cf4f786b9de1 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:54.199366 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 204/440] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:20:53 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:20:54.207476 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-76c8a489-d8f4-40db-bf88-cf4f786b9de1 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:54.207955 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-76c8a489-d8f4-40db-bf88-cf4f786b9de1 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:54.208422 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-76c8a489-d8f4-40db-bf88-cf4f786b9de1 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:54.209110 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-76c8a489-d8f4-40db-bf88-cf4f786b9de1 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:54.209550 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-76c8a489-d8f4-40db-bf88-cf4f786b9de1 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:54.209965 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-76c8a489-d8f4-40db-bf88-cf4f786b9de1 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:54.359623 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-76c8a489-d8f4-40db-bf88-cf4f786b9de1 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:54.369038 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-76c8a489-d8f4-40db-bf88-cf4f786b9de1 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.176025 Aug 09 11:20:54.369923 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 237/441] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:54 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:55.216109 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-99cdbeb3-30d1-433f-b108-798192067a1f tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:55.216688 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-99cdbeb3-30d1-433f-b108-798192067a1f tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:55.223381 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-26678e16-c018-4e01-b10d-a838e0ab7d15 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:55.223984 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-26678e16-c018-4e01-b10d-a838e0ab7d15 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:55.224180 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-99cdbeb3-30d1-433f-b108-798192067a1f tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:55.224716 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-99cdbeb3-30d1-433f-b108-798192067a1f tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:55.225144 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-99cdbeb3-30d1-433f-b108-798192067a1f tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:55.225840 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-99cdbeb3-30d1-433f-b108-798192067a1f tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:55.226281 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-99cdbeb3-30d1-433f-b108-798192067a1f tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:55.226805 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-99cdbeb3-30d1-433f-b108-798192067a1f tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:55.230767 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-26678e16-c018-4e01-b10d-a838e0ab7d15 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:55.231251 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-26678e16-c018-4e01-b10d-a838e0ab7d15 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:55.231679 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-26678e16-c018-4e01-b10d-a838e0ab7d15 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:55.232398 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-26678e16-c018-4e01-b10d-a838e0ab7d15 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:55.232846 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-26678e16-c018-4e01-b10d-a838e0ab7d15 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:55.233297 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-26678e16-c018-4e01-b10d-a838e0ab7d15 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:55.431236 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-99cdbeb3-30d1-433f-b108-798192067a1f tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:55.433901 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-26678e16-c018-4e01-b10d-a838e0ab7d15 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:55.438930 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-99cdbeb3-30d1-433f-b108-798192067a1f tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1261 microversion: 2.1 time: 0.229040 Aug 09 11:20:55.439701 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 205/442] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:55 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1261 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:55.442789 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-26678e16-c018-4e01-b10d-a838e0ab7d15 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:55.444340 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-26678e16-c018-4e01-b10d-a838e0ab7d15 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:55.445986 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-26678e16-c018-4e01-b10d-a838e0ab7d15 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.226878 Aug 09 11:20:55.446719 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 238/443] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:20:55 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:20:55.449625 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-d5e81795-50d8-4a79-bcb8-51e07cf16b16 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:55.450233 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-d5e81795-50d8-4a79-bcb8-51e07cf16b16 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:55.456531 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d5e81795-50d8-4a79-bcb8-51e07cf16b16 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:55.457137 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d5e81795-50d8-4a79-bcb8-51e07cf16b16 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:55.457546 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d5e81795-50d8-4a79-bcb8-51e07cf16b16 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:55.458211 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d5e81795-50d8-4a79-bcb8-51e07cf16b16 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:55.458656 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d5e81795-50d8-4a79-bcb8-51e07cf16b16 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:55.459088 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d5e81795-50d8-4a79-bcb8-51e07cf16b16 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:55.597118 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-d5e81795-50d8-4a79-bcb8-51e07cf16b16 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:55.606102 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-d5e81795-50d8-4a79-bcb8-51e07cf16b16 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.160784 Aug 09 11:20:55.606679 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 206/444] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:55 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:56.463012 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-ad51131e-fd4b-43d6-a20b-8d427fe160dc tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:56.463646 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-ad51131e-fd4b-43d6-a20b-8d427fe160dc tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:56.467977 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-90120a6c-b369-42b5-829d-1859b5f53dd3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:56.468821 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-90120a6c-b369-42b5-829d-1859b5f53dd3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:56.470862 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ad51131e-fd4b-43d6-a20b-8d427fe160dc tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:56.471217 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_api:SELECT=71 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:56.471390 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ad51131e-fd4b-43d6-a20b-8d427fe160dc tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:56.472210 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ad51131e-fd4b-43d6-a20b-8d427fe160dc tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:56.473134 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ad51131e-fd4b-43d6-a20b-8d427fe160dc tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:56.473648 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ad51131e-fd4b-43d6-a20b-8d427fe160dc tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:56.474269 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ad51131e-fd4b-43d6-a20b-8d427fe160dc tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:56.477183 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-90120a6c-b369-42b5-829d-1859b5f53dd3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:56.477686 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-90120a6c-b369-42b5-829d-1859b5f53dd3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:56.478168 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-90120a6c-b369-42b5-829d-1859b5f53dd3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:56.478918 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-90120a6c-b369-42b5-829d-1859b5f53dd3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:56.479365 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-90120a6c-b369-42b5-829d-1859b5f53dd3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:56.479819 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-90120a6c-b369-42b5-829d-1859b5f53dd3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:56.669569 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-ad51131e-fd4b-43d6-a20b-8d427fe160dc tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:56.672880 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-90120a6c-b369-42b5-829d-1859b5f53dd3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:56.677446 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-ad51131e-fd4b-43d6-a20b-8d427fe160dc tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1261 microversion: 2.1 time: 0.220284 Aug 09 11:20:56.678143 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 239/445] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:56 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1261 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:56.682061 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-90120a6c-b369-42b5-829d-1859b5f53dd3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:56.682782 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-0803a0b1-60dc-4f28-a302-9ba36397696a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:56.683545 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-0803a0b1-60dc-4f28-a302-9ba36397696a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:56.683677 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-90120a6c-b369-42b5-829d-1859b5f53dd3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:56.684790 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-90120a6c-b369-42b5-829d-1859b5f53dd3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.220864 Aug 09 11:20:56.685523 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 207/446] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:20:56 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:20:56.689521 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0803a0b1-60dc-4f28-a302-9ba36397696a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:56.690007 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0803a0b1-60dc-4f28-a302-9ba36397696a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:56.690456 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0803a0b1-60dc-4f28-a302-9ba36397696a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:56.691143 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0803a0b1-60dc-4f28-a302-9ba36397696a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:56.691566 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0803a0b1-60dc-4f28-a302-9ba36397696a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:56.691996 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0803a0b1-60dc-4f28-a302-9ba36397696a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:56.822868 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-0803a0b1-60dc-4f28-a302-9ba36397696a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:56.830532 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-0803a0b1-60dc-4f28-a302-9ba36397696a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.151445 Aug 09 11:20:56.831112 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 240/447] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:56 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:57.701072 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-5e54fb54-0e2a-448a-934d-caeb37e72ed5 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:57.701763 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-5e54fb54-0e2a-448a-934d-caeb37e72ed5 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:57.709272 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-8dfe6b10-2484-48c2-9a46-40eac6d827cf tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:57.709865 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5e54fb54-0e2a-448a-934d-caeb37e72ed5 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:57.709983 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-8dfe6b10-2484-48c2-9a46-40eac6d827cf tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:57.710259 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5e54fb54-0e2a-448a-934d-caeb37e72ed5 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:57.710890 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5e54fb54-0e2a-448a-934d-caeb37e72ed5 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:57.712289 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5e54fb54-0e2a-448a-934d-caeb37e72ed5 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:57.712825 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5e54fb54-0e2a-448a-934d-caeb37e72ed5 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:57.713332 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5e54fb54-0e2a-448a-934d-caeb37e72ed5 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:57.717604 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8dfe6b10-2484-48c2-9a46-40eac6d827cf tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:57.718173 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8dfe6b10-2484-48c2-9a46-40eac6d827cf tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:57.718671 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8dfe6b10-2484-48c2-9a46-40eac6d827cf tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:57.719456 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8dfe6b10-2484-48c2-9a46-40eac6d827cf tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:57.719961 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8dfe6b10-2484-48c2-9a46-40eac6d827cf tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:57.720476 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8dfe6b10-2484-48c2-9a46-40eac6d827cf tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:57.911445 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-5e54fb54-0e2a-448a-934d-caeb37e72ed5 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:57.915577 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-8dfe6b10-2484-48c2-9a46-40eac6d827cf tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:57.920134 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-5e54fb54-0e2a-448a-934d-caeb37e72ed5 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1261 microversion: 2.1 time: 0.223614 Aug 09 11:20:57.927111 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 208/448] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:57 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1261 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:57.927111 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-95ba7a78-3a2f-4fd8-b508-de7f1456185f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:57.927111 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-95ba7a78-3a2f-4fd8-b508-de7f1456185f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:57.931044 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-8dfe6b10-2484-48c2-9a46-40eac6d827cf tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:57.932003 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-95ba7a78-3a2f-4fd8-b508-de7f1456185f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:57.932515 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-95ba7a78-3a2f-4fd8-b508-de7f1456185f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:57.932667 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-8dfe6b10-2484-48c2-9a46-40eac6d827cf tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:57.932944 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-95ba7a78-3a2f-4fd8-b508-de7f1456185f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:57.933622 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-95ba7a78-3a2f-4fd8-b508-de7f1456185f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:57.933881 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-8dfe6b10-2484-48c2-9a46-40eac6d827cf tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.229288 Aug 09 11:20:57.934077 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-95ba7a78-3a2f-4fd8-b508-de7f1456185f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:57.934470 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 241/449] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:20:57 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:20:57.934611 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-95ba7a78-3a2f-4fd8-b508-de7f1456185f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:58.070695 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-95ba7a78-3a2f-4fd8-b508-de7f1456185f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:58.078646 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-95ba7a78-3a2f-4fd8-b508-de7f1456185f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.156937 Aug 09 11:20:58.079150 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 209/450] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:57 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:58.942212 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-15c2ad0f-658e-4cb9-897c-e44f0f52d8f1 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:58.942813 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-15c2ad0f-658e-4cb9-897c-e44f0f52d8f1 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:58.949992 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-15c2ad0f-658e-4cb9-897c-e44f0f52d8f1 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:58.950468 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-15c2ad0f-658e-4cb9-897c-e44f0f52d8f1 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:58.950889 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-15c2ad0f-658e-4cb9-897c-e44f0f52d8f1 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:58.951542 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-15c2ad0f-658e-4cb9-897c-e44f0f52d8f1 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:58.952042 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-15c2ad0f-658e-4cb9-897c-e44f0f52d8f1 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:58.952515 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-15c2ad0f-658e-4cb9-897c-e44f0f52d8f1 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:58.957016 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-cbe38abb-fe84-4bb0-9596-5aaad042025d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:58.957586 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-cbe38abb-fe84-4bb0-9596-5aaad042025d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:58.964655 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cbe38abb-fe84-4bb0-9596-5aaad042025d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:58.965133 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cbe38abb-fe84-4bb0-9596-5aaad042025d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:58.965574 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cbe38abb-fe84-4bb0-9596-5aaad042025d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:58.966262 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cbe38abb-fe84-4bb0-9596-5aaad042025d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:58.966705 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cbe38abb-fe84-4bb0-9596-5aaad042025d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:58.967122 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cbe38abb-fe84-4bb0-9596-5aaad042025d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:59.156677 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-15c2ad0f-658e-4cb9-897c-e44f0f52d8f1 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:59.160948 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-cbe38abb-fe84-4bb0-9596-5aaad042025d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:59.164810 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-15c2ad0f-658e-4cb9-897c-e44f0f52d8f1 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1261 microversion: 2.1 time: 0.226422 Aug 09 11:20:59.165391 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 242/451] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:58 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1261 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:59.169898 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-cbe38abb-fe84-4bb0-9596-5aaad042025d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:59.170051 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-8008a085-dad4-46de-8c76-a73d2858d2a0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:59.170597 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-8008a085-dad4-46de-8c76-a73d2858d2a0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:20:59.171714 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-cbe38abb-fe84-4bb0-9596-5aaad042025d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:59.172982 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-cbe38abb-fe84-4bb0-9596-5aaad042025d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.220100 Aug 09 11:20:59.173801 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 210/452] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:20:58 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:20:59.177160 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8008a085-dad4-46de-8c76-a73d2858d2a0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:59.177645 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8008a085-dad4-46de-8c76-a73d2858d2a0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:59.178080 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8008a085-dad4-46de-8c76-a73d2858d2a0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:59.178778 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8008a085-dad4-46de-8c76-a73d2858d2a0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:20:59.179222 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8008a085-dad4-46de-8c76-a73d2858d2a0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:20:59.179641 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8008a085-dad4-46de-8c76-a73d2858d2a0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:20:59.318861 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-8008a085-dad4-46de-8c76-a73d2858d2a0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:20:59.330309 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-8008a085-dad4-46de-8c76-a73d2858d2a0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.163894 Aug 09 11:20:59.331135 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 243/453] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:20:59 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:00.196714 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-886002cf-5650-4305-9271-0c83ecd3aa60 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:00.197367 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-886002cf-5650-4305-9271-0c83ecd3aa60 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:00.200390 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-4bf46395-c270-4297-a061-409e9afa8593 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:00.201023 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-4bf46395-c270-4297-a061-409e9afa8593 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:00.204061 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-886002cf-5650-4305-9271-0c83ecd3aa60 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:00.204641 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-886002cf-5650-4305-9271-0c83ecd3aa60 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:00.205072 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-886002cf-5650-4305-9271-0c83ecd3aa60 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:00.205764 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-886002cf-5650-4305-9271-0c83ecd3aa60 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:00.206210 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-886002cf-5650-4305-9271-0c83ecd3aa60 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:00.206620 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-886002cf-5650-4305-9271-0c83ecd3aa60 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:00.207420 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4bf46395-c270-4297-a061-409e9afa8593 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:00.207889 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4bf46395-c270-4297-a061-409e9afa8593 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:00.208459 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4bf46395-c270-4297-a061-409e9afa8593 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:00.209142 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4bf46395-c270-4297-a061-409e9afa8593 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:00.209584 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4bf46395-c270-4297-a061-409e9afa8593 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:00.209997 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4bf46395-c270-4297-a061-409e9afa8593 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:00.407002 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-886002cf-5650-4305-9271-0c83ecd3aa60 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:00.411292 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-4bf46395-c270-4297-a061-409e9afa8593 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:00.414658 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-886002cf-5650-4305-9271-0c83ecd3aa60 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1261 microversion: 2.1 time: 0.222418 Aug 09 11:21:00.415279 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 211/454] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:00 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1261 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:00.420039 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-6a7d578a-e798-4d01-9a47-ec16f22357d7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:00.420607 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-4bf46395-c270-4297-a061-409e9afa8593 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:00.420762 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-6a7d578a-e798-4d01-9a47-ec16f22357d7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:00.422263 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-4bf46395-c270-4297-a061-409e9afa8593 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:00.423467 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-4bf46395-c270-4297-a061-409e9afa8593 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.227292 Aug 09 11:21:00.424206 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 244/455] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:21:00 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:21:00.427010 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6a7d578a-e798-4d01-9a47-ec16f22357d7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:00.427498 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6a7d578a-e798-4d01-9a47-ec16f22357d7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:00.427926 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6a7d578a-e798-4d01-9a47-ec16f22357d7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:00.428612 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6a7d578a-e798-4d01-9a47-ec16f22357d7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:00.429265 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6a7d578a-e798-4d01-9a47-ec16f22357d7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:00.429671 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6a7d578a-e798-4d01-9a47-ec16f22357d7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:00.561619 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-6a7d578a-e798-4d01-9a47-ec16f22357d7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:00.569584 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-6a7d578a-e798-4d01-9a47-ec16f22357d7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.153345 Aug 09 11:21:00.570228 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 212/456] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:00 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:01.446925 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-b3d9813a-7f39-4a13-9368-c0bfef448a6d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:01.448388 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-b3d9813a-7f39-4a13-9368-c0bfef448a6d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:01.449764 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-c5d1981d-a20c-4aaa-be81-76a74c805657 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:01.450846 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-c5d1981d-a20c-4aaa-be81-76a74c805657 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:01.455102 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b3d9813a-7f39-4a13-9368-c0bfef448a6d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:01.455588 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b3d9813a-7f39-4a13-9368-c0bfef448a6d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:01.456030 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b3d9813a-7f39-4a13-9368-c0bfef448a6d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:01.456763 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b3d9813a-7f39-4a13-9368-c0bfef448a6d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:01.457378 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b3d9813a-7f39-4a13-9368-c0bfef448a6d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:01.457843 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b3d9813a-7f39-4a13-9368-c0bfef448a6d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:01.460151 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c5d1981d-a20c-4aaa-be81-76a74c805657 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:01.469689 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c5d1981d-a20c-4aaa-be81-76a74c805657 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:01.470561 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c5d1981d-a20c-4aaa-be81-76a74c805657 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:01.471176 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c5d1981d-a20c-4aaa-be81-76a74c805657 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:01.472047 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c5d1981d-a20c-4aaa-be81-76a74c805657 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:01.472629 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c5d1981d-a20c-4aaa-be81-76a74c805657 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:01.494619 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell1:SELECT=100 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:21:01.663597 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-b3d9813a-7f39-4a13-9368-c0bfef448a6d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:01.675141 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-b3d9813a-7f39-4a13-9368-c0bfef448a6d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:01.676565 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-b3d9813a-7f39-4a13-9368-c0bfef448a6d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:01.677773 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-b3d9813a-7f39-4a13-9368-c0bfef448a6d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.234773 Aug 09 11:21:01.688324 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 213/457] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:21:01 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:21:01.688324 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-28c13d90-9ab6-4cf4-9c30-69a22eb35513 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:01.688324 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-28c13d90-9ab6-4cf4-9c30-69a22eb35513 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:01.691831 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-28c13d90-9ab6-4cf4-9c30-69a22eb35513 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:01.692341 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-28c13d90-9ab6-4cf4-9c30-69a22eb35513 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:01.692778 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-28c13d90-9ab6-4cf4-9c30-69a22eb35513 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:01.693507 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-28c13d90-9ab6-4cf4-9c30-69a22eb35513 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:01.693950 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-28c13d90-9ab6-4cf4-9c30-69a22eb35513 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:01.694364 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-28c13d90-9ab6-4cf4-9c30-69a22eb35513 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:01.698487 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-c5d1981d-a20c-4aaa-be81-76a74c805657 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:01.706433 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-c5d1981d-a20c-4aaa-be81-76a74c805657 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1261 microversion: 2.1 time: 0.262116 Aug 09 11:21:01.707014 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 245/458] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:01 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1261 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:01.833998 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-28c13d90-9ab6-4cf4-9c30-69a22eb35513 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:01.842959 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-28c13d90-9ab6-4cf4-9c30-69a22eb35513 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.162930 Aug 09 11:21:01.843531 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 214/459] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:01 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:02.704758 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-aa9c801f-a468-40a3-b1b7-73482c671591 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:02.705513 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-aa9c801f-a468-40a3-b1b7-73482c671591 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:02.712083 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-aa9c801f-a468-40a3-b1b7-73482c671591 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:02.712601 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-aa9c801f-a468-40a3-b1b7-73482c671591 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:02.713026 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-aa9c801f-a468-40a3-b1b7-73482c671591 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:02.713714 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-aa9c801f-a468-40a3-b1b7-73482c671591 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:02.714149 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-aa9c801f-a468-40a3-b1b7-73482c671591 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:02.714776 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-aa9c801f-a468-40a3-b1b7-73482c671591 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:02.727492 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-6b08b368-6e63-44cc-b108-47582da91c0e tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:02.728097 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-6b08b368-6e63-44cc-b108-47582da91c0e tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:02.735147 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6b08b368-6e63-44cc-b108-47582da91c0e tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:02.735636 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6b08b368-6e63-44cc-b108-47582da91c0e tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:02.736064 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6b08b368-6e63-44cc-b108-47582da91c0e tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:02.736794 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6b08b368-6e63-44cc-b108-47582da91c0e tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:02.737242 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6b08b368-6e63-44cc-b108-47582da91c0e tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:02.737657 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6b08b368-6e63-44cc-b108-47582da91c0e tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:02.922213 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-aa9c801f-a468-40a3-b1b7-73482c671591 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:02.930802 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-6b08b368-6e63-44cc-b108-47582da91c0e tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:02.931590 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-aa9c801f-a468-40a3-b1b7-73482c671591 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:02.933311 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-aa9c801f-a468-40a3-b1b7-73482c671591 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:02.934491 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-aa9c801f-a468-40a3-b1b7-73482c671591 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.234151 Aug 09 11:21:02.935387 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 246/460] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:21:02 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:21:02.939110 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-6b08b368-6e63-44cc-b108-47582da91c0e tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1261 microversion: 2.1 time: 0.215526 Aug 09 11:21:02.939657 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-7e0440ca-b8f2-4a9d-9fb8-d5795d1b4a77 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:02.940304 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-7e0440ca-b8f2-4a9d-9fb8-d5795d1b4a77 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:02.946188 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7e0440ca-b8f2-4a9d-9fb8-d5795d1b4a77 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:02.946664 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7e0440ca-b8f2-4a9d-9fb8-d5795d1b4a77 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:02.947086 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7e0440ca-b8f2-4a9d-9fb8-d5795d1b4a77 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:02.947822 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7e0440ca-b8f2-4a9d-9fb8-d5795d1b4a77 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:02.948206 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7e0440ca-b8f2-4a9d-9fb8-d5795d1b4a77 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:02.948650 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7e0440ca-b8f2-4a9d-9fb8-d5795d1b4a77 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:02.952395 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 215/461] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:02 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1261 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:03.077139 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-7e0440ca-b8f2-4a9d-9fb8-d5795d1b4a77 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:03.084955 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-7e0440ca-b8f2-4a9d-9fb8-d5795d1b4a77 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.148714 Aug 09 11:21:03.085524 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 247/462] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:02 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:03.958279 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-f1be3747-8126-481a-81ca-6fc4e9bedca3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:03.958989 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-f1be3747-8126-481a-81ca-6fc4e9bedca3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:03.959155 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-76953565-57e1-44f9-86b8-d90237738643 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:03.959585 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-76953565-57e1-44f9-86b8-d90237738643 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:03.965989 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f1be3747-8126-481a-81ca-6fc4e9bedca3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:03.966147 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-76953565-57e1-44f9-86b8-d90237738643 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:03.966479 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f1be3747-8126-481a-81ca-6fc4e9bedca3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:03.966755 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-76953565-57e1-44f9-86b8-d90237738643 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:03.966911 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f1be3747-8126-481a-81ca-6fc4e9bedca3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:03.967311 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-76953565-57e1-44f9-86b8-d90237738643 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:03.967842 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f1be3747-8126-481a-81ca-6fc4e9bedca3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:03.967982 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-76953565-57e1-44f9-86b8-d90237738643 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:03.968297 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f1be3747-8126-481a-81ca-6fc4e9bedca3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:03.968546 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-76953565-57e1-44f9-86b8-d90237738643 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:03.968817 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f1be3747-8126-481a-81ca-6fc4e9bedca3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:03.968948 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-76953565-57e1-44f9-86b8-d90237738643 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:04.169229 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-f1be3747-8126-481a-81ca-6fc4e9bedca3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:04.172858 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-76953565-57e1-44f9-86b8-d90237738643 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:04.178232 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-f1be3747-8126-481a-81ca-6fc4e9bedca3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:04.179694 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-f1be3747-8126-481a-81ca-6fc4e9bedca3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:04.180538 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-76953565-57e1-44f9-86b8-d90237738643 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1261 microversion: 2.1 time: 0.225412 Aug 09 11:21:04.180876 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-f1be3747-8126-481a-81ca-6fc4e9bedca3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.226628 Aug 09 11:21:04.181148 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 248/463] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:03 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1261 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:04.181612 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 216/464] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:21:03 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:21:04.185787 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-dcb6fc3c-da4f-4306-862b-c723f0765248 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:04.186363 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-dcb6fc3c-da4f-4306-862b-c723f0765248 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:04.192627 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-dcb6fc3c-da4f-4306-862b-c723f0765248 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:04.193117 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-dcb6fc3c-da4f-4306-862b-c723f0765248 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:04.193556 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-dcb6fc3c-da4f-4306-862b-c723f0765248 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:04.194235 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-dcb6fc3c-da4f-4306-862b-c723f0765248 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:04.194676 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-dcb6fc3c-da4f-4306-862b-c723f0765248 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:04.195095 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-dcb6fc3c-da4f-4306-862b-c723f0765248 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:04.333669 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-dcb6fc3c-da4f-4306-862b-c723f0765248 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:04.341309 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-dcb6fc3c-da4f-4306-862b-c723f0765248 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.159140 Aug 09 11:21:04.342322 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 249/465] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:04 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:05.076321 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [req-6c3b0e79-829d-478c-9892-81dc5ece51f5 req-b67ca493-06a9-4ff3-b2c4-f83d4d4dd0f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b683e1f9-1d37-46d4-a7a1-9f15b514336e", "name": "network-vif-plugged", "status": "completed", "tag": "afc665af-24eb-4ff3-8263-bd971e0a7488"}]} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:21:05.091105 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-6c3b0e79-829d-478c-9892-81dc5ece51f5 req-b67ca493-06a9-4ff3-b2c4-f83d4d4dd0f0 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:05.092680 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-6c3b0e79-829d-478c-9892-81dc5ece51f5 req-b67ca493-06a9-4ff3-b2c4-f83d4d4dd0f0 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:05.093738 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-6c3b0e79-829d-478c-9892-81dc5ece51f5 req-b67ca493-06a9-4ff3-b2c4-f83d4d4dd0f0 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:05.121637 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.compute.server_external_events [req-6c3b0e79-829d-478c-9892-81dc5ece51f5 req-b67ca493-06a9-4ff3-b2c4-f83d4d4dd0f0 service nova] Creating event network-vif-plugged:afc665af-24eb-4ff3-8263-bd971e0a7488 for instance b683e1f9-1d37-46d4-a7a1-9f15b514336e on hv-cinder-85251 Aug 09 11:21:05.127653 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [req-6c3b0e79-829d-478c-9892-81dc5ece51f5 req-b67ca493-06a9-4ff3-b2c4-f83d4d4dd0f0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055215 Aug 09 11:21:05.128508 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 217/466] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:21:05.203220 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-90059f05-8f2b-49d4-8617-a5902c4e59fc tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:05.203854 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-90059f05-8f2b-49d4-8617-a5902c4e59fc tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:05.206562 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-ca8e37ca-64b7-48cd-9cc4-61e2a912007f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:05.207508 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-ca8e37ca-64b7-48cd-9cc4-61e2a912007f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:05.210702 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-90059f05-8f2b-49d4-8617-a5902c4e59fc tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:05.211197 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-90059f05-8f2b-49d4-8617-a5902c4e59fc tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:05.211628 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-90059f05-8f2b-49d4-8617-a5902c4e59fc tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:05.212374 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-90059f05-8f2b-49d4-8617-a5902c4e59fc tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:05.212865 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-90059f05-8f2b-49d4-8617-a5902c4e59fc tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:05.213290 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-90059f05-8f2b-49d4-8617-a5902c4e59fc tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:05.216049 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ca8e37ca-64b7-48cd-9cc4-61e2a912007f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:05.216835 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ca8e37ca-64b7-48cd-9cc4-61e2a912007f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:05.218298 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ca8e37ca-64b7-48cd-9cc4-61e2a912007f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:05.219028 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ca8e37ca-64b7-48cd-9cc4-61e2a912007f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:05.219521 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ca8e37ca-64b7-48cd-9cc4-61e2a912007f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:05.220157 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ca8e37ca-64b7-48cd-9cc4-61e2a912007f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:05.473465 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-90059f05-8f2b-49d4-8617-a5902c4e59fc tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:05.485098 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-90059f05-8f2b-49d4-8617-a5902c4e59fc tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1261 microversion: 2.1 time: 0.285952 Aug 09 11:21:05.496341 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 250/467] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:05 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1261 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:05.496679 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-ca8e37ca-64b7-48cd-9cc4-61e2a912007f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:05.496679 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell1:SELECT=100 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:21:05.502949 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-e8ae5412-609f-4597-aa55-7a4dc82553f5 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:05.503733 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-e8ae5412-609f-4597-aa55-7a4dc82553f5 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:05.505407 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-ca8e37ca-64b7-48cd-9cc4-61e2a912007f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:05.507087 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-ca8e37ca-64b7-48cd-9cc4-61e2a912007f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:05.508756 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-ca8e37ca-64b7-48cd-9cc4-61e2a912007f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.309388 Aug 09 11:21:05.509834 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 218/468] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:21:05 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:21:05.516841 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e8ae5412-609f-4597-aa55-7a4dc82553f5 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:05.517328 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e8ae5412-609f-4597-aa55-7a4dc82553f5 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:05.517912 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e8ae5412-609f-4597-aa55-7a4dc82553f5 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:05.518804 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e8ae5412-609f-4597-aa55-7a4dc82553f5 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:05.519246 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e8ae5412-609f-4597-aa55-7a4dc82553f5 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:05.519832 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e8ae5412-609f-4597-aa55-7a4dc82553f5 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:05.657706 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-e8ae5412-609f-4597-aa55-7a4dc82553f5 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:05.668169 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-e8ae5412-609f-4597-aa55-7a4dc82553f5 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.180552 Aug 09 11:21:05.669085 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 251/469] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:05 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:06.090140 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-2a873474-ee92-42a3-9675-5fb21be7b56f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:06.090672 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-2a873474-ee92-42a3-9675-5fb21be7b56f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:06.098077 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2a873474-ee92-42a3-9675-5fb21be7b56f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:06.098965 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2a873474-ee92-42a3-9675-5fb21be7b56f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:06.099719 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2a873474-ee92-42a3-9675-5fb21be7b56f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:06.100956 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2a873474-ee92-42a3-9675-5fb21be7b56f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:06.101636 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2a873474-ee92-42a3-9675-5fb21be7b56f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:06.102372 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2a873474-ee92-42a3-9675-5fb21be7b56f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:06.235898 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.objects.instance [None req-2a873474-ee92-42a3-9675-5fb21be7b56f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lazy-loading 'services' on Instance uuid fb805071-5bf8-4c52-9f89-b4bb1272121f {{(pid=117684) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:21:06.365924 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-2a873474-ee92-42a3-9675-5fb21be7b56f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f/os-volume_attachments/c6288cef-a74d-4fd7-a93a-8631e2154217" status: 202 len: 0 microversion: 2.1 time: 0.279777 Aug 09 11:21:06.366615 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 219/470] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Aug 9 11:21:06 2022] DELETE /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f/os-volume_attachments/c6288cef-a74d-4fd7-a93a-8631e2154217 => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:21:06.507640 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-aa7588d5-a82e-4796-ae27-7c119cdc1702 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:06.508216 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-aa7588d5-a82e-4796-ae27-7c119cdc1702 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:06.510407 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_api:SELECT=72 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:21:06.516253 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-aa7588d5-a82e-4796-ae27-7c119cdc1702 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:06.516781 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-aa7588d5-a82e-4796-ae27-7c119cdc1702 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:06.517207 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-aa7588d5-a82e-4796-ae27-7c119cdc1702 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:06.517882 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-aa7588d5-a82e-4796-ae27-7c119cdc1702 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:06.518320 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-aa7588d5-a82e-4796-ae27-7c119cdc1702 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:06.518757 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-aa7588d5-a82e-4796-ae27-7c119cdc1702 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:06.534001 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-689339d9-2a76-4834-aa44-9043f55412f2 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:06.534999 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-689339d9-2a76-4834-aa44-9043f55412f2 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:06.541648 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-689339d9-2a76-4834-aa44-9043f55412f2 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:06.542128 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-689339d9-2a76-4834-aa44-9043f55412f2 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:06.542552 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-689339d9-2a76-4834-aa44-9043f55412f2 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:06.543237 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-689339d9-2a76-4834-aa44-9043f55412f2 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:06.543907 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-689339d9-2a76-4834-aa44-9043f55412f2 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:06.544346 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-689339d9-2a76-4834-aa44-9043f55412f2 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:06.720291 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-aa7588d5-a82e-4796-ae27-7c119cdc1702 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:06.728606 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-aa7588d5-a82e-4796-ae27-7c119cdc1702 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1261 microversion: 2.1 time: 0.225269 Aug 09 11:21:06.729316 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 252/471] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:06 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1261 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:06.734226 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-57155da2-e3f3-43a1-95f2-f65219109dc0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:06.734813 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-57155da2-e3f3-43a1-95f2-f65219109dc0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:06.740842 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-57155da2-e3f3-43a1-95f2-f65219109dc0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:06.741315 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-57155da2-e3f3-43a1-95f2-f65219109dc0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:06.741729 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-57155da2-e3f3-43a1-95f2-f65219109dc0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:06.742399 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-57155da2-e3f3-43a1-95f2-f65219109dc0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:06.742842 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-57155da2-e3f3-43a1-95f2-f65219109dc0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:06.743253 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-57155da2-e3f3-43a1-95f2-f65219109dc0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:06.746337 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-689339d9-2a76-4834-aa44-9043f55412f2 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:06.756918 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-689339d9-2a76-4834-aa44-9043f55412f2 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:06.758798 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-689339d9-2a76-4834-aa44-9043f55412f2 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:06.760420 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-689339d9-2a76-4834-aa44-9043f55412f2 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.230736 Aug 09 11:21:06.761115 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 220/472] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:21:06 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:21:06.891347 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-57155da2-e3f3-43a1-95f2-f65219109dc0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:06.903535 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-57155da2-e3f3-43a1-95f2-f65219109dc0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.172951 Aug 09 11:21:06.904134 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 253/473] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:06 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:07.749042 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-97760c38-99f2-48ff-b97c-bf375a30da40 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:07.749647 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-97760c38-99f2-48ff-b97c-bf375a30da40 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:07.756615 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-97760c38-99f2-48ff-b97c-bf375a30da40 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:07.757033 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-97760c38-99f2-48ff-b97c-bf375a30da40 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:07.757458 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-97760c38-99f2-48ff-b97c-bf375a30da40 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:07.758143 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-97760c38-99f2-48ff-b97c-bf375a30da40 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:07.758584 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-97760c38-99f2-48ff-b97c-bf375a30da40 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:07.758996 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-97760c38-99f2-48ff-b97c-bf375a30da40 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:07.784537 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-dd0fecf9-9306-4796-98f0-254402f68258 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:07.785257 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-dd0fecf9-9306-4796-98f0-254402f68258 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:07.793185 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-dd0fecf9-9306-4796-98f0-254402f68258 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:07.793777 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-dd0fecf9-9306-4796-98f0-254402f68258 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:07.794270 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-dd0fecf9-9306-4796-98f0-254402f68258 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:07.795028 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-dd0fecf9-9306-4796-98f0-254402f68258 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:07.795578 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-dd0fecf9-9306-4796-98f0-254402f68258 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:07.796077 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-dd0fecf9-9306-4796-98f0-254402f68258 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:07.979324 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-97760c38-99f2-48ff-b97c-bf375a30da40 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:07.982496 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-dd0fecf9-9306-4796-98f0-254402f68258 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:07.988462 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-97760c38-99f2-48ff-b97c-bf375a30da40 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1261 microversion: 2.1 time: 0.243219 Aug 09 11:21:07.989164 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 221/474] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:07 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1261 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:07.991578 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-dd0fecf9-9306-4796-98f0-254402f68258 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:07.993307 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-dd0fecf9-9306-4796-98f0-254402f68258 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:07.994535 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-dd0fecf9-9306-4796-98f0-254402f68258 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.214236 Aug 09 11:21:07.994848 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-876c33e8-5269-4481-a5fa-977fa83a85c9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:07.995649 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-876c33e8-5269-4481-a5fa-977fa83a85c9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:08.002181 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-876c33e8-5269-4481-a5fa-977fa83a85c9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:08.002876 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-876c33e8-5269-4481-a5fa-977fa83a85c9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:08.003443 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-876c33e8-5269-4481-a5fa-977fa83a85c9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:08.004185 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-876c33e8-5269-4481-a5fa-977fa83a85c9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:08.004678 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-876c33e8-5269-4481-a5fa-977fa83a85c9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:08.005104 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-876c33e8-5269-4481-a5fa-977fa83a85c9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:08.008635 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 254/475] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:21:07 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 11:21:08.143081 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-876c33e8-5269-4481-a5fa-977fa83a85c9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:08.152285 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-876c33e8-5269-4481-a5fa-977fa83a85c9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.161863 Aug 09 11:21:08.152936 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 222/476] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:07 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:09.014776 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-d0b48e2c-2504-44e5-acba-bf2e7ef8d55d tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:09.016430 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-d0b48e2c-2504-44e5-acba-bf2e7ef8d55d tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:09.022148 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-adef747a-6629-4d51-b6e8-32968e16b793 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:09.023183 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-adef747a-6629-4d51-b6e8-32968e16b793 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:09.027252 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d0b48e2c-2504-44e5-acba-bf2e7ef8d55d tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:09.028086 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d0b48e2c-2504-44e5-acba-bf2e7ef8d55d tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:09.028838 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d0b48e2c-2504-44e5-acba-bf2e7ef8d55d tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:09.029963 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d0b48e2c-2504-44e5-acba-bf2e7ef8d55d tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:09.030727 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d0b48e2c-2504-44e5-acba-bf2e7ef8d55d tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:09.031693 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d0b48e2c-2504-44e5-acba-bf2e7ef8d55d tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:09.033168 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-adef747a-6629-4d51-b6e8-32968e16b793 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:09.033644 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-adef747a-6629-4d51-b6e8-32968e16b793 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:09.034068 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-adef747a-6629-4d51-b6e8-32968e16b793 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:09.034744 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-adef747a-6629-4d51-b6e8-32968e16b793 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:09.035186 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-adef747a-6629-4d51-b6e8-32968e16b793 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:09.035597 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-adef747a-6629-4d51-b6e8-32968e16b793 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:09.224697 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-adef747a-6629-4d51-b6e8-32968e16b793 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:09.229263 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-d0b48e2c-2504-44e5-acba-bf2e7ef8d55d tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:09.234044 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-adef747a-6629-4d51-b6e8-32968e16b793 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:09.235768 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-adef747a-6629-4d51-b6e8-32968e16b793 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:09.236970 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-adef747a-6629-4d51-b6e8-32968e16b793 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.222117 Aug 09 11:21:09.237408 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-d0b48e2c-2504-44e5-acba-bf2e7ef8d55d tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1261 microversion: 2.1 time: 0.228904 Aug 09 11:21:09.252051 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 223/477] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:21:09 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:21:09.252245 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 255/478] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:09 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1261 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:09.252365 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-1b9c2533-ce06-4696-9566-bfdba246ad3a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:09.252365 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-1b9c2533-ce06-4696-9566-bfdba246ad3a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:09.252365 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1b9c2533-ce06-4696-9566-bfdba246ad3a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:09.252365 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1b9c2533-ce06-4696-9566-bfdba246ad3a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:09.252682 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1b9c2533-ce06-4696-9566-bfdba246ad3a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:09.252682 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1b9c2533-ce06-4696-9566-bfdba246ad3a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:09.252682 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1b9c2533-ce06-4696-9566-bfdba246ad3a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:09.252682 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1b9c2533-ce06-4696-9566-bfdba246ad3a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:09.389031 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-1b9c2533-ce06-4696-9566-bfdba246ad3a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:09.397486 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-1b9c2533-ce06-4696-9566-bfdba246ad3a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.158764 Aug 09 11:21:09.398087 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 224/479] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:09 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:10.265705 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-c14382ce-cd17-41b0-9f6c-25a9a3d57ac9 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:10.266933 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-d34294a2-55cd-4997-83c6-6c61c726f5a0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:10.267594 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-d34294a2-55cd-4997-83c6-6c61c726f5a0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:10.272753 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-c14382ce-cd17-41b0-9f6c-25a9a3d57ac9 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:10.275057 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d34294a2-55cd-4997-83c6-6c61c726f5a0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:10.275886 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d34294a2-55cd-4997-83c6-6c61c726f5a0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:10.276472 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d34294a2-55cd-4997-83c6-6c61c726f5a0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:10.277152 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d34294a2-55cd-4997-83c6-6c61c726f5a0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:10.277603 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d34294a2-55cd-4997-83c6-6c61c726f5a0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:10.278086 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d34294a2-55cd-4997-83c6-6c61c726f5a0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:10.279575 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c14382ce-cd17-41b0-9f6c-25a9a3d57ac9 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:10.280142 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c14382ce-cd17-41b0-9f6c-25a9a3d57ac9 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:10.280681 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c14382ce-cd17-41b0-9f6c-25a9a3d57ac9 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:10.282399 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c14382ce-cd17-41b0-9f6c-25a9a3d57ac9 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:10.283055 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c14382ce-cd17-41b0-9f6c-25a9a3d57ac9 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:10.283564 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c14382ce-cd17-41b0-9f6c-25a9a3d57ac9 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:10.708934 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-d34294a2-55cd-4997-83c6-6c61c726f5a0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:10.712234 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-c14382ce-cd17-41b0-9f6c-25a9a3d57ac9 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:10.722018 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-c14382ce-cd17-41b0-9f6c-25a9a3d57ac9 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1261 microversion: 2.1 time: 0.467846 Aug 09 11:21:10.732515 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 256/480] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:10 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1261 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:10.732515 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-97d63551-2834-4754-a25f-2c246d7cc822 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:10.732515 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-97d63551-2834-4754-a25f-2c246d7cc822 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:10.738128 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-d34294a2-55cd-4997-83c6-6c61c726f5a0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:10.739802 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-d34294a2-55cd-4997-83c6-6c61c726f5a0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:10.741439 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-97d63551-2834-4754-a25f-2c246d7cc822 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:10.742205 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-97d63551-2834-4754-a25f-2c246d7cc822 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:10.742936 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-97d63551-2834-4754-a25f-2c246d7cc822 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:10.744578 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-d34294a2-55cd-4997-83c6-6c61c726f5a0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.488910 Aug 09 11:21:10.745157 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 225/481] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:21:10 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:21:10.745715 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-97d63551-2834-4754-a25f-2c246d7cc822 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:10.746265 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-97d63551-2834-4754-a25f-2c246d7cc822 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:10.746789 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-97d63551-2834-4754-a25f-2c246d7cc822 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:10.884371 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-97d63551-2834-4754-a25f-2c246d7cc822 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:10.892963 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-97d63551-2834-4754-a25f-2c246d7cc822 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.169040 Aug 09 11:21:10.893540 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 257/482] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:10 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:11.744763 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-39fb1b20-cca4-4703-b7b2-b4ce6f38f0a1 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:11.745372 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-39fb1b20-cca4-4703-b7b2-b4ce6f38f0a1 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:11.752373 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-39fb1b20-cca4-4703-b7b2-b4ce6f38f0a1 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:11.752851 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-39fb1b20-cca4-4703-b7b2-b4ce6f38f0a1 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:11.753289 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-39fb1b20-cca4-4703-b7b2-b4ce6f38f0a1 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:11.754008 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-39fb1b20-cca4-4703-b7b2-b4ce6f38f0a1 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:11.754429 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-39fb1b20-cca4-4703-b7b2-b4ce6f38f0a1 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:11.754855 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-39fb1b20-cca4-4703-b7b2-b4ce6f38f0a1 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:11.770145 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-1dccdaf6-9c33-4140-878c-dfdd77424ef7 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:11.770923 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-1dccdaf6-9c33-4140-878c-dfdd77424ef7 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:11.777794 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1dccdaf6-9c33-4140-878c-dfdd77424ef7 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:11.778283 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1dccdaf6-9c33-4140-878c-dfdd77424ef7 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:11.778715 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1dccdaf6-9c33-4140-878c-dfdd77424ef7 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:11.779401 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1dccdaf6-9c33-4140-878c-dfdd77424ef7 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:11.779852 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1dccdaf6-9c33-4140-878c-dfdd77424ef7 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:11.780300 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1dccdaf6-9c33-4140-878c-dfdd77424ef7 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:11.956469 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-39fb1b20-cca4-4703-b7b2-b4ce6f38f0a1 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:11.964237 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-1dccdaf6-9c33-4140-878c-dfdd77424ef7 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:11.964424 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-39fb1b20-cca4-4703-b7b2-b4ce6f38f0a1 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1261 microversion: 2.1 time: 0.223460 Aug 09 11:21:11.964903 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 226/483] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:11 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1261 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:11.969774 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-6abd14c2-2d29-4269-9eaf-ca22224cf77f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:11.970375 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-6abd14c2-2d29-4269-9eaf-ca22224cf77f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:11.974346 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-1dccdaf6-9c33-4140-878c-dfdd77424ef7 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:11.975833 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-1dccdaf6-9c33-4140-878c-dfdd77424ef7 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:11.976214 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6abd14c2-2d29-4269-9eaf-ca22224cf77f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:11.976738 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6abd14c2-2d29-4269-9eaf-ca22224cf77f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:11.977165 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-1dccdaf6-9c33-4140-878c-dfdd77424ef7 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.212041 Aug 09 11:21:11.977286 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6abd14c2-2d29-4269-9eaf-ca22224cf77f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:11.977737 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 258/484] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:21:11 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 11:21:11.977899 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6abd14c2-2d29-4269-9eaf-ca22224cf77f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:11.978254 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6abd14c2-2d29-4269-9eaf-ca22224cf77f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:11.978666 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6abd14c2-2d29-4269-9eaf-ca22224cf77f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:12.113754 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-6abd14c2-2d29-4269-9eaf-ca22224cf77f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:12.121371 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-6abd14c2-2d29-4269-9eaf-ca22224cf77f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.155528 Aug 09 11:21:12.121931 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 227/485] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:11 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:12.985153 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-69be0717-fe7b-4a42-a70c-94f37c091c71 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:12.985754 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-69be0717-fe7b-4a42-a70c-94f37c091c71 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:12.992896 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-69be0717-fe7b-4a42-a70c-94f37c091c71 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:12.993379 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-69be0717-fe7b-4a42-a70c-94f37c091c71 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:12.993810 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-69be0717-fe7b-4a42-a70c-94f37c091c71 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:12.994501 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-69be0717-fe7b-4a42-a70c-94f37c091c71 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:12.994950 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-69be0717-fe7b-4a42-a70c-94f37c091c71 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:12.995375 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-69be0717-fe7b-4a42-a70c-94f37c091c71 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:13.000372 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-850973af-e08f-49d9-8ae2-6b9e264c7b74 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:13.001199 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-850973af-e08f-49d9-8ae2-6b9e264c7b74 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:13.007886 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-850973af-e08f-49d9-8ae2-6b9e264c7b74 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:13.008300 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-850973af-e08f-49d9-8ae2-6b9e264c7b74 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:13.008753 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-850973af-e08f-49d9-8ae2-6b9e264c7b74 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:13.009444 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-850973af-e08f-49d9-8ae2-6b9e264c7b74 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:13.009885 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-850973af-e08f-49d9-8ae2-6b9e264c7b74 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:13.010287 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-850973af-e08f-49d9-8ae2-6b9e264c7b74 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:13.194724 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-69be0717-fe7b-4a42-a70c-94f37c091c71 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:13.200118 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-850973af-e08f-49d9-8ae2-6b9e264c7b74 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:13.205426 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-69be0717-fe7b-4a42-a70c-94f37c091c71 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1261 microversion: 2.1 time: 0.224296 Aug 09 11:21:13.206019 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 259/486] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:12 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1261 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:13.210230 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-850973af-e08f-49d9-8ae2-6b9e264c7b74 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:13.210435 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-1e25b55c-023d-4096-a0d3-2edd9573e2c2 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:13.211125 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-1e25b55c-023d-4096-a0d3-2edd9573e2c2 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:13.211728 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-850973af-e08f-49d9-8ae2-6b9e264c7b74 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:13.212894 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-850973af-e08f-49d9-8ae2-6b9e264c7b74 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.216476 Aug 09 11:21:13.213423 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 228/487] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:21:12 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:21:13.217010 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1e25b55c-023d-4096-a0d3-2edd9573e2c2 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:13.217487 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1e25b55c-023d-4096-a0d3-2edd9573e2c2 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:13.217878 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1e25b55c-023d-4096-a0d3-2edd9573e2c2 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:13.218764 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1e25b55c-023d-4096-a0d3-2edd9573e2c2 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:13.219398 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1e25b55c-023d-4096-a0d3-2edd9573e2c2 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:13.219956 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1e25b55c-023d-4096-a0d3-2edd9573e2c2 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:13.357317 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-1e25b55c-023d-4096-a0d3-2edd9573e2c2 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:13.365504 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-1e25b55c-023d-4096-a0d3-2edd9573e2c2 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.158537 Aug 09 11:21:13.366085 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 260/488] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:13 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:14.230491 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-9d8153f5-a93b-4912-959f-772a0d7df7ca tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:14.231617 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-9d8153f5-a93b-4912-959f-772a0d7df7ca tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:14.241226 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-83a67442-7a82-4a76-a52f-d5069a83bf48 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:14.242392 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-83a67442-7a82-4a76-a52f-d5069a83bf48 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:14.242637 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9d8153f5-a93b-4912-959f-772a0d7df7ca tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:14.243193 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9d8153f5-a93b-4912-959f-772a0d7df7ca tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:14.243909 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9d8153f5-a93b-4912-959f-772a0d7df7ca tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:14.245054 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9d8153f5-a93b-4912-959f-772a0d7df7ca tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:14.245839 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9d8153f5-a93b-4912-959f-772a0d7df7ca tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:14.246543 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9d8153f5-a93b-4912-959f-772a0d7df7ca tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:14.253087 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-83a67442-7a82-4a76-a52f-d5069a83bf48 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:14.253589 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-83a67442-7a82-4a76-a52f-d5069a83bf48 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:14.254005 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-83a67442-7a82-4a76-a52f-d5069a83bf48 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:14.254708 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-83a67442-7a82-4a76-a52f-d5069a83bf48 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:14.255152 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-83a67442-7a82-4a76-a52f-d5069a83bf48 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:14.255569 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-83a67442-7a82-4a76-a52f-d5069a83bf48 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:14.444759 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-9d8153f5-a93b-4912-959f-772a0d7df7ca tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:14.448862 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-83a67442-7a82-4a76-a52f-d5069a83bf48 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:14.452878 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-9d8153f5-a93b-4912-959f-772a0d7df7ca tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1261 microversion: 2.1 time: 0.228928 Aug 09 11:21:14.453444 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 229/489] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:14 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1261 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:14.457998 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-83a67442-7a82-4a76-a52f-d5069a83bf48 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:14.458182 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-f964f51d-99e1-403c-bbc1-b7dc1ad24e69 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:14.458947 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-f964f51d-99e1-403c-bbc1-b7dc1ad24e69 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:14.459469 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-83a67442-7a82-4a76-a52f-d5069a83bf48 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:14.460711 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-83a67442-7a82-4a76-a52f-d5069a83bf48 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.226918 Aug 09 11:21:14.469456 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 261/490] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:21:14 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:21:14.469629 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f964f51d-99e1-403c-bbc1-b7dc1ad24e69 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:14.469629 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f964f51d-99e1-403c-bbc1-b7dc1ad24e69 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:14.469629 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f964f51d-99e1-403c-bbc1-b7dc1ad24e69 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:14.469629 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f964f51d-99e1-403c-bbc1-b7dc1ad24e69 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:14.470068 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f964f51d-99e1-403c-bbc1-b7dc1ad24e69 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:14.470068 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f964f51d-99e1-403c-bbc1-b7dc1ad24e69 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:14.598403 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-f964f51d-99e1-403c-bbc1-b7dc1ad24e69 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:14.606275 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-f964f51d-99e1-403c-bbc1-b7dc1ad24e69 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.151605 Aug 09 11:21:14.606787 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 230/491] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:14 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:14.681677 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 11:21:14.681996 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Tue Aug 9 11:21:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 11:21:15.474659 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-51d1b54e-b83c-470c-b204-3830b2bd08aa tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:15.475325 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-51d1b54e-b83c-470c-b204-3830b2bd08aa tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:15.482812 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-51d1b54e-b83c-470c-b204-3830b2bd08aa tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:15.483390 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-51d1b54e-b83c-470c-b204-3830b2bd08aa tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:15.483895 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-51d1b54e-b83c-470c-b204-3830b2bd08aa tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:15.484611 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-17cbaa45-7ace-4550-b789-d111ce4597c3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:15.485172 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-51d1b54e-b83c-470c-b204-3830b2bd08aa tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:15.485921 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-51d1b54e-b83c-470c-b204-3830b2bd08aa tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:15.486065 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-17cbaa45-7ace-4550-b789-d111ce4597c3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:15.486354 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-51d1b54e-b83c-470c-b204-3830b2bd08aa tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:15.491337 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell1:SELECT=100 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:21:15.492162 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-17cbaa45-7ace-4550-b789-d111ce4597c3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:15.492884 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-17cbaa45-7ace-4550-b789-d111ce4597c3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:15.493155 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-17cbaa45-7ace-4550-b789-d111ce4597c3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:15.493919 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-17cbaa45-7ace-4550-b789-d111ce4597c3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:15.494609 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-17cbaa45-7ace-4550-b789-d111ce4597c3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:15.495022 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-17cbaa45-7ace-4550-b789-d111ce4597c3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:15.687795 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-51d1b54e-b83c-470c-b204-3830b2bd08aa tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:15.692309 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-17cbaa45-7ace-4550-b789-d111ce4597c3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:15.696491 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-51d1b54e-b83c-470c-b204-3830b2bd08aa tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1261 microversion: 2.1 time: 0.225693 Aug 09 11:21:15.697046 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 262/492] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:15 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1261 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:15.701032 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-17cbaa45-7ace-4550-b789-d111ce4597c3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:15.701446 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-5681c4f7-099b-4b42-b233-222e73a29fbb tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:15.702047 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-5681c4f7-099b-4b42-b233-222e73a29fbb tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:15.702566 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-17cbaa45-7ace-4550-b789-d111ce4597c3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:15.703774 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-17cbaa45-7ace-4550-b789-d111ce4597c3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.223766 Aug 09 11:21:15.704333 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 231/493] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:21:15 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 11:21:15.707856 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5681c4f7-099b-4b42-b233-222e73a29fbb tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:15.708428 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5681c4f7-099b-4b42-b233-222e73a29fbb tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:15.708795 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5681c4f7-099b-4b42-b233-222e73a29fbb tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:15.709484 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5681c4f7-099b-4b42-b233-222e73a29fbb tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:15.709933 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5681c4f7-099b-4b42-b233-222e73a29fbb tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:15.710350 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5681c4f7-099b-4b42-b233-222e73a29fbb tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:15.854238 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-5681c4f7-099b-4b42-b233-222e73a29fbb tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:15.862347 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-5681c4f7-099b-4b42-b233-222e73a29fbb tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.164364 Aug 09 11:21:15.862999 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 263/494] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:15 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:16.721276 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-42a6e52f-7530-4694-892d-7553d0a5df00 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:16.722327 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-42a6e52f-7530-4694-892d-7553d0a5df00 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:16.730305 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-24c4d744-a676-4dc2-b44d-536b8ccdea42 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:16.731274 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-24c4d744-a676-4dc2-b44d-536b8ccdea42 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:16.733731 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-42a6e52f-7530-4694-892d-7553d0a5df00 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:16.734529 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-42a6e52f-7530-4694-892d-7553d0a5df00 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:16.735241 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-42a6e52f-7530-4694-892d-7553d0a5df00 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:16.736446 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-42a6e52f-7530-4694-892d-7553d0a5df00 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:16.737164 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-42a6e52f-7530-4694-892d-7553d0a5df00 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:16.737883 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-42a6e52f-7530-4694-892d-7553d0a5df00 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:16.741016 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-24c4d744-a676-4dc2-b44d-536b8ccdea42 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:16.741493 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-24c4d744-a676-4dc2-b44d-536b8ccdea42 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:16.741954 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-24c4d744-a676-4dc2-b44d-536b8ccdea42 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:16.745740 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-24c4d744-a676-4dc2-b44d-536b8ccdea42 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:16.745740 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-24c4d744-a676-4dc2-b44d-536b8ccdea42 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:16.745740 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-24c4d744-a676-4dc2-b44d-536b8ccdea42 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:16.945510 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-42a6e52f-7530-4694-892d-7553d0a5df00 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:16.949290 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-24c4d744-a676-4dc2-b44d-536b8ccdea42 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:16.953421 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-42a6e52f-7530-4694-892d-7553d0a5df00 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1261 microversion: 2.1 time: 0.238728 Aug 09 11:21:16.953995 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 232/495] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:16 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1261 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:16.958130 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-24c4d744-a676-4dc2-b44d-536b8ccdea42 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:16.958780 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-cc120680-8e0b-465e-a21f-888296390b42 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:16.959383 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-cc120680-8e0b-465e-a21f-888296390b42 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:16.959732 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-24c4d744-a676-4dc2-b44d-536b8ccdea42 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:16.960896 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-24c4d744-a676-4dc2-b44d-536b8ccdea42 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.237024 Aug 09 11:21:16.961436 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 264/496] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:21:16 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:21:16.970152 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cc120680-8e0b-465e-a21f-888296390b42 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:16.970152 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cc120680-8e0b-465e-a21f-888296390b42 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:16.970152 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cc120680-8e0b-465e-a21f-888296390b42 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:16.970152 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cc120680-8e0b-465e-a21f-888296390b42 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:16.970540 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cc120680-8e0b-465e-a21f-888296390b42 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:16.970540 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cc120680-8e0b-465e-a21f-888296390b42 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:17.124872 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-cc120680-8e0b-465e-a21f-888296390b42 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:17.133412 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-cc120680-8e0b-465e-a21f-888296390b42 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.178364 Aug 09 11:21:17.134001 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 233/497] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:16 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:17.974725 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-1685c86d-7e99-4810-8811-04393be218d5 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:17.975329 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-1685c86d-7e99-4810-8811-04393be218d5 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:17.982312 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1685c86d-7e99-4810-8811-04393be218d5 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:17.982810 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1685c86d-7e99-4810-8811-04393be218d5 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:17.983018 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-1181ee74-1cbb-47d6-b724-a63140f67703 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:17.983480 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1685c86d-7e99-4810-8811-04393be218d5 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:17.983807 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-1181ee74-1cbb-47d6-b724-a63140f67703 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:17.983982 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1685c86d-7e99-4810-8811-04393be218d5 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:17.984363 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1685c86d-7e99-4810-8811-04393be218d5 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:17.984790 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1685c86d-7e99-4810-8811-04393be218d5 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:17.990440 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1181ee74-1cbb-47d6-b724-a63140f67703 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:17.990918 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1181ee74-1cbb-47d6-b724-a63140f67703 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:17.991345 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1181ee74-1cbb-47d6-b724-a63140f67703 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:17.992029 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1181ee74-1cbb-47d6-b724-a63140f67703 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:17.992518 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1181ee74-1cbb-47d6-b724-a63140f67703 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:17.992917 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1181ee74-1cbb-47d6-b724-a63140f67703 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:18.188615 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-1685c86d-7e99-4810-8811-04393be218d5 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:18.191343 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-1181ee74-1cbb-47d6-b724-a63140f67703 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:18.195763 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:21:18.196618 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-1685c86d-7e99-4810-8811-04393be218d5 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1261 microversion: 2.1 time: 0.226249 Aug 09 11:21:18.197350 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 265/498] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:17 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1261 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:18.204315 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-1181ee74-1cbb-47d6-b724-a63140f67703 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:18.204726 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-1181ee74-1cbb-47d6-b724-a63140f67703 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:18.206072 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-1181ee74-1cbb-47d6-b724-a63140f67703 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.226951 Aug 09 11:21:18.207626 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 234/499] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:21:17 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:21:18.210781 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-eaa4d104-98cc-4207-9b82-ec35258fc789 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:18.211384 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-eaa4d104-98cc-4207-9b82-ec35258fc789 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:18.217432 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-eaa4d104-98cc-4207-9b82-ec35258fc789 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:18.217906 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-eaa4d104-98cc-4207-9b82-ec35258fc789 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:18.218328 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-eaa4d104-98cc-4207-9b82-ec35258fc789 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:18.219008 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-eaa4d104-98cc-4207-9b82-ec35258fc789 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:18.219445 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-eaa4d104-98cc-4207-9b82-ec35258fc789 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:18.219856 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-eaa4d104-98cc-4207-9b82-ec35258fc789 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:18.356392 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-eaa4d104-98cc-4207-9b82-ec35258fc789 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:18.363986 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-eaa4d104-98cc-4207-9b82-ec35258fc789 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.157831 Aug 09 11:21:18.364590 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 266/500] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:18 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:19.218090 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-5c987e35-dd04-4fe7-87e7-ac168db3e9ae tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:19.218769 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-5c987e35-dd04-4fe7-87e7-ac168db3e9ae tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:19.226457 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5c987e35-dd04-4fe7-87e7-ac168db3e9ae tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:19.226986 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5c987e35-dd04-4fe7-87e7-ac168db3e9ae tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:19.227660 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5c987e35-dd04-4fe7-87e7-ac168db3e9ae tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:19.228386 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5c987e35-dd04-4fe7-87e7-ac168db3e9ae tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:19.228839 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5c987e35-dd04-4fe7-87e7-ac168db3e9ae tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:19.229256 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5c987e35-dd04-4fe7-87e7-ac168db3e9ae tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:19.232501 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-fa634a84-1f70-4555-839f-9a7e94574fc2 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:19.233113 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-fa634a84-1f70-4555-839f-9a7e94574fc2 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:19.239619 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fa634a84-1f70-4555-839f-9a7e94574fc2 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:19.240098 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fa634a84-1f70-4555-839f-9a7e94574fc2 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:19.240740 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fa634a84-1f70-4555-839f-9a7e94574fc2 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:19.241601 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fa634a84-1f70-4555-839f-9a7e94574fc2 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:19.242049 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fa634a84-1f70-4555-839f-9a7e94574fc2 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:19.242476 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fa634a84-1f70-4555-839f-9a7e94574fc2 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:19.426150 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-5c987e35-dd04-4fe7-87e7-ac168db3e9ae tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:19.432973 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-fa634a84-1f70-4555-839f-9a7e94574fc2 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:19.435778 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-5c987e35-dd04-4fe7-87e7-ac168db3e9ae tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1261 microversion: 2.1 time: 0.221571 Aug 09 11:21:19.436618 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 235/501] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:19 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1261 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:19.441052 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-2a46fc87-8ede-46e0-a7b6-0cb752eab6b3 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:19.441677 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-2a46fc87-8ede-46e0-a7b6-0cb752eab6b3 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:19.442152 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-fa634a84-1f70-4555-839f-9a7e94574fc2 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:19.444335 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-fa634a84-1f70-4555-839f-9a7e94574fc2 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:19.445511 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-fa634a84-1f70-4555-839f-9a7e94574fc2 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.217108 Aug 09 11:21:19.446046 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 267/502] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:21:19 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 11:21:19.447923 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2a46fc87-8ede-46e0-a7b6-0cb752eab6b3 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:19.448422 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2a46fc87-8ede-46e0-a7b6-0cb752eab6b3 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:19.448848 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2a46fc87-8ede-46e0-a7b6-0cb752eab6b3 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:19.449533 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2a46fc87-8ede-46e0-a7b6-0cb752eab6b3 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:19.449972 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2a46fc87-8ede-46e0-a7b6-0cb752eab6b3 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:19.450382 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2a46fc87-8ede-46e0-a7b6-0cb752eab6b3 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:19.581822 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-2a46fc87-8ede-46e0-a7b6-0cb752eab6b3 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:19.589566 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-2a46fc87-8ede-46e0-a7b6-0cb752eab6b3 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.152223 Aug 09 11:21:19.590134 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 236/503] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:19 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:20.460412 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-5b13b3e5-2c07-4de9-aa3b-4e3649e49890 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:20.460989 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-5b13b3e5-2c07-4de9-aa3b-4e3649e49890 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:20.468158 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5b13b3e5-2c07-4de9-aa3b-4e3649e49890 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:20.468685 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5b13b3e5-2c07-4de9-aa3b-4e3649e49890 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:20.468854 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-7c98172f-5e99-4c22-b1ad-67a4d00cf39e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:20.469278 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5b13b3e5-2c07-4de9-aa3b-4e3649e49890 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:20.469380 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-7c98172f-5e99-4c22-b1ad-67a4d00cf39e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:20.469865 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5b13b3e5-2c07-4de9-aa3b-4e3649e49890 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:20.470339 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5b13b3e5-2c07-4de9-aa3b-4e3649e49890 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:20.470778 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5b13b3e5-2c07-4de9-aa3b-4e3649e49890 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:20.476452 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7c98172f-5e99-4c22-b1ad-67a4d00cf39e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:20.476965 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7c98172f-5e99-4c22-b1ad-67a4d00cf39e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:20.477410 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7c98172f-5e99-4c22-b1ad-67a4d00cf39e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:20.478125 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7c98172f-5e99-4c22-b1ad-67a4d00cf39e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:20.478589 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7c98172f-5e99-4c22-b1ad-67a4d00cf39e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:20.479056 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7c98172f-5e99-4c22-b1ad-67a4d00cf39e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:20.671316 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-5b13b3e5-2c07-4de9-aa3b-4e3649e49890 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:20.674225 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-7c98172f-5e99-4c22-b1ad-67a4d00cf39e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:20.679446 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-5b13b3e5-2c07-4de9-aa3b-4e3649e49890 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1261 microversion: 2.1 time: 0.225174 Aug 09 11:21:20.680090 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 268/504] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:20 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1261 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:20.683416 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-7c98172f-5e99-4c22-b1ad-67a4d00cf39e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:20.684597 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-88c098ae-84df-4adc-81b4-6868a0326abc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:20.684930 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-7c98172f-5e99-4c22-b1ad-67a4d00cf39e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:20.685188 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-88c098ae-84df-4adc-81b4-6868a0326abc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:20.686108 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-7c98172f-5e99-4c22-b1ad-67a4d00cf39e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.221528 Aug 09 11:21:20.689892 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 237/505] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:21:20 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:21:20.691370 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-88c098ae-84df-4adc-81b4-6868a0326abc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:20.691849 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-88c098ae-84df-4adc-81b4-6868a0326abc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:20.692326 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-88c098ae-84df-4adc-81b4-6868a0326abc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:20.693018 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-88c098ae-84df-4adc-81b4-6868a0326abc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:20.693488 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-88c098ae-84df-4adc-81b4-6868a0326abc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:20.693901 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-88c098ae-84df-4adc-81b4-6868a0326abc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:20.827414 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-88c098ae-84df-4adc-81b4-6868a0326abc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:20.837259 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-88c098ae-84df-4adc-81b4-6868a0326abc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.156190 Aug 09 11:21:20.837811 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 269/506] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:20 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:21.700806 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-18dc0ce4-eda3-40f2-965f-caf11d741f1a tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:21.701445 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-18dc0ce4-eda3-40f2-965f-caf11d741f1a tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:21.708177 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-18dc0ce4-eda3-40f2-965f-caf11d741f1a tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:21.708687 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-18dc0ce4-eda3-40f2-965f-caf11d741f1a tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:21.709120 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-1bd31b9c-b9e6-4f8f-9a3f-28a639a73534 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:21.709690 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-18dc0ce4-eda3-40f2-965f-caf11d741f1a tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:21.709778 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-1bd31b9c-b9e6-4f8f-9a3f-28a639a73534 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:21.710364 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-18dc0ce4-eda3-40f2-965f-caf11d741f1a tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:21.710812 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-18dc0ce4-eda3-40f2-965f-caf11d741f1a tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:21.711218 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-18dc0ce4-eda3-40f2-965f-caf11d741f1a tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:21.716214 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1bd31b9c-b9e6-4f8f-9a3f-28a639a73534 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:21.716736 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1bd31b9c-b9e6-4f8f-9a3f-28a639a73534 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:21.717150 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1bd31b9c-b9e6-4f8f-9a3f-28a639a73534 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:21.717832 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1bd31b9c-b9e6-4f8f-9a3f-28a639a73534 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:21.718265 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1bd31b9c-b9e6-4f8f-9a3f-28a639a73534 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:21.718676 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1bd31b9c-b9e6-4f8f-9a3f-28a639a73534 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:21.909208 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-18dc0ce4-eda3-40f2-965f-caf11d741f1a tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:21.914547 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-1bd31b9c-b9e6-4f8f-9a3f-28a639a73534 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:21.918203 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-18dc0ce4-eda3-40f2-965f-caf11d741f1a tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1261 microversion: 2.1 time: 0.221277 Aug 09 11:21:21.919012 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 238/507] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:21 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1261 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:21.923630 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-637a8318-ddb5-4a8a-ba28-2adb4cb49e87 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:21.924498 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-637a8318-ddb5-4a8a-ba28-2adb4cb49e87 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:21.927649 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-1bd31b9c-b9e6-4f8f-9a3f-28a639a73534 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:21.928938 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-1bd31b9c-b9e6-4f8f-9a3f-28a639a73534 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:21.930148 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-1bd31b9c-b9e6-4f8f-9a3f-28a639a73534 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.225015 Aug 09 11:21:21.930680 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 270/508] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:21:21 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:21:21.931140 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-637a8318-ddb5-4a8a-ba28-2adb4cb49e87 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:21.931580 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-637a8318-ddb5-4a8a-ba28-2adb4cb49e87 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:21.932203 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-637a8318-ddb5-4a8a-ba28-2adb4cb49e87 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:21.932925 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-637a8318-ddb5-4a8a-ba28-2adb4cb49e87 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:21.933362 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-637a8318-ddb5-4a8a-ba28-2adb4cb49e87 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:21.933772 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-637a8318-ddb5-4a8a-ba28-2adb4cb49e87 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:22.070946 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-637a8318-ddb5-4a8a-ba28-2adb4cb49e87 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:22.082029 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-637a8318-ddb5-4a8a-ba28-2adb4cb49e87 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.161896 Aug 09 11:21:22.082895 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 239/509] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:21 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:22.908992 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-7885e847-1bcc-4201-a5fb-4dcd16334992 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:22.909545 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-7885e847-1bcc-4201-a5fb-4dcd16334992 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: eee55879-1bf3-41e4-b439-0c903100e828] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:22.916893 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7885e847-1bcc-4201-a5fb-4dcd16334992 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:22.917462 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7885e847-1bcc-4201-a5fb-4dcd16334992 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:22.918033 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7885e847-1bcc-4201-a5fb-4dcd16334992 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:22.918681 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7885e847-1bcc-4201-a5fb-4dcd16334992 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:22.919122 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7885e847-1bcc-4201-a5fb-4dcd16334992 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:22.919541 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7885e847-1bcc-4201-a5fb-4dcd16334992 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:22.944134 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-7885e847-1bcc-4201-a5fb-4dcd16334992 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828/ips" status: 200 len: 150 microversion: 2.1 time: 0.040113 Aug 09 11:21:22.944926 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 271/510] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Aug 9 11:21:22 2022] GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:21:22.954016 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-0a5f7b4c-fbe2-40c7-9329-6d6cce587e83 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:22.954815 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-0a5f7b4c-fbe2-40c7-9329-6d6cce587e83 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:22.956252 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-4cf32e78-540f-4e6c-94bd-ce56decce92a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:22.956895 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-4cf32e78-540f-4e6c-94bd-ce56decce92a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:22.963270 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0a5f7b4c-fbe2-40c7-9329-6d6cce587e83 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:22.963475 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4cf32e78-540f-4e6c-94bd-ce56decce92a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:22.963757 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0a5f7b4c-fbe2-40c7-9329-6d6cce587e83 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:22.963939 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4cf32e78-540f-4e6c-94bd-ce56decce92a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:22.964186 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0a5f7b4c-fbe2-40c7-9329-6d6cce587e83 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:22.964399 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4cf32e78-540f-4e6c-94bd-ce56decce92a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:22.964922 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0a5f7b4c-fbe2-40c7-9329-6d6cce587e83 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:22.965091 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4cf32e78-540f-4e6c-94bd-ce56decce92a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:22.965367 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0a5f7b4c-fbe2-40c7-9329-6d6cce587e83 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:22.965539 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4cf32e78-540f-4e6c-94bd-ce56decce92a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:22.965786 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0a5f7b4c-fbe2-40c7-9329-6d6cce587e83 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:22.965956 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4cf32e78-540f-4e6c-94bd-ce56decce92a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:23.163882 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-4cf32e78-540f-4e6c-94bd-ce56decce92a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:23.169444 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-0a5f7b4c-fbe2-40c7-9329-6d6cce587e83 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:23.173100 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-4cf32e78-540f-4e6c-94bd-ce56decce92a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:23.174883 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-4cf32e78-540f-4e6c-94bd-ce56decce92a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:23.176292 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-4cf32e78-540f-4e6c-94bd-ce56decce92a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.223928 Aug 09 11:21:23.177087 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 272/511] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:21:22 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:21:23.178510 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-0a5f7b4c-fbe2-40c7-9329-6d6cce587e83 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1261 microversion: 2.1 time: 0.236108 Aug 09 11:21:23.179323 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 240/512] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:22 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1261 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:23.182978 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-50c58c68-0219-456e-b9ee-7117f04c8dd2 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "397e1f98-323e-4201-be0c-de0567926b8a"}} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:21:23.185657 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-50c58c68-0219-456e-b9ee-7117f04c8dd2 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: eee55879-1bf3-41e4-b439-0c903100e828] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:23.192841 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-50c58c68-0219-456e-b9ee-7117f04c8dd2 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:23.193430 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-feb333c6-0bf2-4ecf-a82b-7bfedda254cb tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:23.194095 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-50c58c68-0219-456e-b9ee-7117f04c8dd2 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:23.194352 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-feb333c6-0bf2-4ecf-a82b-7bfedda254cb tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:23.194544 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-50c58c68-0219-456e-b9ee-7117f04c8dd2 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:23.195220 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-50c58c68-0219-456e-b9ee-7117f04c8dd2 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:23.195661 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-50c58c68-0219-456e-b9ee-7117f04c8dd2 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:23.196072 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-50c58c68-0219-456e-b9ee-7117f04c8dd2 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:23.200864 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-feb333c6-0bf2-4ecf-a82b-7bfedda254cb tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:23.201373 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-feb333c6-0bf2-4ecf-a82b-7bfedda254cb tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:23.201827 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-feb333c6-0bf2-4ecf-a82b-7bfedda254cb tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:23.202518 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-feb333c6-0bf2-4ecf-a82b-7bfedda254cb tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:23.203012 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-feb333c6-0bf2-4ecf-a82b-7bfedda254cb tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:23.203425 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-feb333c6-0bf2-4ecf-a82b-7bfedda254cb tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:23.285017 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.wsgi [None req-50c58c68-0219-456e-b9ee-7117f04c8dd2 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] HTTP exception thrown: Invalid volume: volume 397e1f98-323e-4201-be0c-de0567926b8a is already attached to instances: 1329e8e9-9358-454d-bea3-dad19dfc53da Aug 09 11:21:23.286982 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-50c58c68-0219-456e-b9ee-7117f04c8dd2 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Request method failure captured: Aug 09 11:21:23.286982 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: request: POST /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828/os-volume_attachments HTTP/1.1 Aug 09 11:21:23.286982 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Accept: application/json Aug 09 11:21:23.286982 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Accept-Encoding: identity Aug 09 11:21:23.286982 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Connection: close Aug 09 11:21:23.286982 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Content-Length: 74 Aug 09 11:21:23.286982 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Content-Type: application/json Aug 09 11:21:23.286982 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Host: 10.222.0.27 Aug 09 11:21:23.286982 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Openstack-System-Scope: None Aug 09 11:21:23.286982 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: User-Agent: python-urllib3/1.26.11 Aug 09 11:21:23.286982 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Auth-Token: gAAAAABi8kJrkCuZ0ZtlZIUmAC-EK2I0okp8exzRXbUBoHrpFGaG17TfS3kn4sSvkBzyMOMoCBQBmvOs9UrhF5xw2U46aP5Pxlq5Kj8piUuPsDzn7s8ETM_3P18gyColYBDIhcjSMUGohuoeVN3S8QIKYIofZURyiH1QY4Vi6NWdxWuymPkih0k Aug 09 11:21:23.286982 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Domain-Id: None Aug 09 11:21:23.286982 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Domain-Name: None Aug 09 11:21:23.286982 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Identity-Status: Confirmed Aug 09 11:21:23.286982 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Is-Admin-Project: True Aug 09 11:21:23.286982 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Domain-Id: default Aug 09 11:21:23.286982 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Domain-Name: Default Aug 09 11:21:23.286982 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Id: cba1dd0b689b4fff847b6fd3787b143c Aug 09 11:21:23.286982 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Name: tempest-AttachVolumeNegativeTest-1410930012 Aug 09 11:21:23.286982 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Role: member,reader Aug 09 11:21:23.286982 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Roles: member,reader Aug 09 11:21:23.289110 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:21:23.289110 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant: tempest-AttachVolumeNegativeTest-1410930012 Aug 09 11:21:23.289110 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant-Id: cba1dd0b689b4fff847b6fd3787b143c Aug 09 11:21:23.289110 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1410930012 Aug 09 11:21:23.289110 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User: tempest-AttachVolumeNegativeTest-1410930012-project Aug 09 11:21:23.289110 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Domain-Id: default Aug 09 11:21:23.289110 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Domain-Name: Default Aug 09 11:21:23.289110 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Id: f4da6dd860bb45d1a703a18c2512ffe4 Aug 09 11:21:23.289110 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Name: tempest-AttachVolumeNegativeTest-1410930012-project Aug 09 11:21:23.289110 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Aug 09 11:21:23.289110 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: {"volumeAttachment": {"volumeId": "397e1f98-323e-4201-be0c-de0567926b8a"}} Aug 09 11:21:23.289110 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: method: > Aug 09 11:21:23.289914 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: exception: Invalid volume: volume 397e1f98-323e-4201-be0c-de0567926b8a is already attached to instances: 1329e8e9-9358-454d-bea3-dad19dfc53da Aug 09 11:21:23.289914 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: action_args: {'server_id': 'eee55879-1bf3-41e4-b439-0c903100e828', 'body': {'volumeAttachment': {'volumeId': '397e1f98-323e-4201-be0c-de0567926b8a'}}} Aug 09 11:21:23.289914 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:21:23.289914 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:21:23.289914 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 09 11:21:23.289914 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 09 11:21:23.289914 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 11:21:23.289914 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 11:21:23.289914 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 09 11:21:23.289914 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 11:21:23.289914 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 09 11:21:23.289914 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 09 11:21:23.289914 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 09 11:21:23.289914 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 09 11:21:23.289914 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 397e1f98-323e-4201-be0c-de0567926b8a is already attached to instances: 1329e8e9-9358-454d-bea3-dad19dfc53da Aug 09 11:21:23.289914 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:21:23.289914 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:21:23.289914 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:21:23.289914 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:21:23.291682 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:21:23.291682 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:21:23.291682 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:21:23.291682 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:21:23.291682 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:21:23.291682 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:21:23.291682 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 11:21:23.291682 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 11:21:23.291682 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 11:21:23.291682 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 11:21:23.291682 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 11:21:23.291682 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 11:21:23.291682 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 09 11:21:23.291682 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 09 11:21:23.291682 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 397e1f98-323e-4201-be0c-de0567926b8a is already attached to instances: 1329e8e9-9358-454d-bea3-dad19dfc53da Aug 09 11:21:23.291682 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:21:23.291682 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:21:23.291682 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:21:23.291682 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:21:23.291682 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:21:23.293357 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:21:23.293357 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:21:23.293357 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:21:23.293357 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 397e1f98-323e-4201-be0c-de0567926b8a is already attached to instances: 1329e8e9-9358-454d-bea3-dad19dfc53da Aug 09 11:21:23.293357 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:21:23.293357 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-50c58c68-0219-456e-b9ee-7117f04c8dd2 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Returning 400 to user: Invalid volume: volume 397e1f98-323e-4201-be0c-de0567926b8a is already attached to instances: 1329e8e9-9358-454d-bea3-dad19dfc53da {{(pid=117685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:21:23.293357 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-50c58c68-0219-456e-b9ee-7117f04c8dd2 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "POST /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.110067 Aug 09 11:21:23.293357 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 273/513] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Aug 9 11:21:23 2022] POST /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828/os-volume_attachments => generated 174 bytes in 111 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 11:21:23.301515 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-f302d964-5984-4f5b-90f7-e9ba653b3702 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:23.302026 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-f302d964-5984-4f5b-90f7-e9ba653b3702 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: eee55879-1bf3-41e4-b439-0c903100e828] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:23.308617 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f302d964-5984-4f5b-90f7-e9ba653b3702 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:23.309100 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f302d964-5984-4f5b-90f7-e9ba653b3702 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:23.309531 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f302d964-5984-4f5b-90f7-e9ba653b3702 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:23.310937 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f302d964-5984-4f5b-90f7-e9ba653b3702 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:23.310937 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f302d964-5984-4f5b-90f7-e9ba653b3702 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:23.311133 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f302d964-5984-4f5b-90f7-e9ba653b3702 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:23.337118 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-f302d964-5984-4f5b-90f7-e9ba653b3702 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: eee55879-1bf3-41e4-b439-0c903100e828] Going to try to terminate instance {{(pid=117685) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 11:21:23.345012 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-feb333c6-0bf2-4ecf-a82b-7bfedda254cb tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:23.353081 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-feb333c6-0bf2-4ecf-a82b-7bfedda254cb tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.172572 Aug 09 11:21:23.353647 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 241/514] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:23 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:23.419669 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-f302d964-5984-4f5b-90f7-e9ba653b3702 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "DELETE /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828" status: 204 len: 0 microversion: 2.1 time: 0.121814 Aug 09 11:21:23.420542 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 274/515] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 9 11:21:23 2022] DELETE /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 11:21:23.429226 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-24e4a080-9e1e-413f-bc2b-7af6f04b39ec tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:23.430012 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-24e4a080-9e1e-413f-bc2b-7af6f04b39ec tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: eee55879-1bf3-41e4-b439-0c903100e828] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:23.437127 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-24e4a080-9e1e-413f-bc2b-7af6f04b39ec tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:23.437829 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-24e4a080-9e1e-413f-bc2b-7af6f04b39ec tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:23.438693 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-24e4a080-9e1e-413f-bc2b-7af6f04b39ec tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:23.440366 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-24e4a080-9e1e-413f-bc2b-7af6f04b39ec tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:23.440923 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-24e4a080-9e1e-413f-bc2b-7af6f04b39ec tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:23.441350 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-24e4a080-9e1e-413f-bc2b-7af6f04b39ec tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:23.573849 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-24e4a080-9e1e-413f-bc2b-7af6f04b39ec tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:23.581651 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-24e4a080-9e1e-413f-bc2b-7af6f04b39ec tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828" status: 200 len: 1682 microversion: 2.1 time: 0.156786 Aug 09 11:21:23.582242 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 242/516] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:23 2022] GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:24.200905 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-14ac930e-1ba3-4c60-95e1-d4416655b101 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:24.201519 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-674e45b3-a2c9-47b6-b840-618611c51fa9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:24.201877 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-14ac930e-1ba3-4c60-95e1-d4416655b101 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:24.201983 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-674e45b3-a2c9-47b6-b840-618611c51fa9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:24.207171 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-14ac930e-1ba3-4c60-95e1-d4416655b101 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:24.207656 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-14ac930e-1ba3-4c60-95e1-d4416655b101 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:24.208085 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-14ac930e-1ba3-4c60-95e1-d4416655b101 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:24.208399 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-674e45b3-a2c9-47b6-b840-618611c51fa9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:24.208800 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-14ac930e-1ba3-4c60-95e1-d4416655b101 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:24.208912 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-674e45b3-a2c9-47b6-b840-618611c51fa9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:24.209244 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-14ac930e-1ba3-4c60-95e1-d4416655b101 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:24.209351 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-674e45b3-a2c9-47b6-b840-618611c51fa9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:24.209663 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-14ac930e-1ba3-4c60-95e1-d4416655b101 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:24.210091 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-674e45b3-a2c9-47b6-b840-618611c51fa9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:24.210803 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-674e45b3-a2c9-47b6-b840-618611c51fa9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:24.211053 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-674e45b3-a2c9-47b6-b840-618611c51fa9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:24.414815 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-14ac930e-1ba3-4c60-95e1-d4416655b101 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:24.420566 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-674e45b3-a2c9-47b6-b840-618611c51fa9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:24.425493 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-14ac930e-1ba3-4c60-95e1-d4416655b101 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1261 microversion: 2.1 time: 0.229902 Aug 09 11:21:24.426292 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 275/517] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:24 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1261 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:24.431273 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-216e30cb-0784-4b79-b1f7-2b7296331594 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:24.431889 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-216e30cb-0784-4b79-b1f7-2b7296331594 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:24.432959 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-674e45b3-a2c9-47b6-b840-618611c51fa9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:24.434640 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-674e45b3-a2c9-47b6-b840-618611c51fa9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:24.435953 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-674e45b3-a2c9-47b6-b840-618611c51fa9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.240500 Aug 09 11:21:24.436623 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 243/518] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:21:24 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:21:24.438994 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-216e30cb-0784-4b79-b1f7-2b7296331594 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:24.439477 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-216e30cb-0784-4b79-b1f7-2b7296331594 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:24.439901 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-216e30cb-0784-4b79-b1f7-2b7296331594 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:24.440621 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-216e30cb-0784-4b79-b1f7-2b7296331594 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:24.441066 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-216e30cb-0784-4b79-b1f7-2b7296331594 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:24.441451 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-216e30cb-0784-4b79-b1f7-2b7296331594 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:24.580331 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-216e30cb-0784-4b79-b1f7-2b7296331594 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:24.592195 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-216e30cb-0784-4b79-b1f7-2b7296331594 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.164408 Aug 09 11:21:24.592924 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 276/519] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:24 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:24.604877 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-66b8c5ec-d605-40a5-a071-352d2dbe50ee tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:24.605487 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-66b8c5ec-d605-40a5-a071-352d2dbe50ee tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: eee55879-1bf3-41e4-b439-0c903100e828] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:24.611930 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-66b8c5ec-d605-40a5-a071-352d2dbe50ee tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:24.612475 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-66b8c5ec-d605-40a5-a071-352d2dbe50ee tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:24.612915 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-66b8c5ec-d605-40a5-a071-352d2dbe50ee tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:24.613610 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-66b8c5ec-d605-40a5-a071-352d2dbe50ee tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:24.614055 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-66b8c5ec-d605-40a5-a071-352d2dbe50ee tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:24.614475 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-66b8c5ec-d605-40a5-a071-352d2dbe50ee tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:24.760435 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-66b8c5ec-d605-40a5-a071-352d2dbe50ee tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:24.768469 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-66b8c5ec-d605-40a5-a071-352d2dbe50ee tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828" status: 200 len: 1682 microversion: 2.1 time: 0.168034 Aug 09 11:21:24.769028 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 244/520] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:24 2022] GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:21:25.447577 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-62ad91a9-373a-4e02-bdf5-47f8b5cff82c tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:25.448163 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-62ad91a9-373a-4e02-bdf5-47f8b5cff82c tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:25.454924 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-62ad91a9-373a-4e02-bdf5-47f8b5cff82c tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:25.455396 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-62ad91a9-373a-4e02-bdf5-47f8b5cff82c tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:25.455828 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-62ad91a9-373a-4e02-bdf5-47f8b5cff82c tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:25.456528 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-62ad91a9-373a-4e02-bdf5-47f8b5cff82c tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:25.456967 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-62ad91a9-373a-4e02-bdf5-47f8b5cff82c tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:25.457379 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-62ad91a9-373a-4e02-bdf5-47f8b5cff82c tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:25.459270 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-226b8732-8cbb-4bcf-8c8b-a5f0bb481ac8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:25.459872 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-226b8732-8cbb-4bcf-8c8b-a5f0bb481ac8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:25.466445 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-226b8732-8cbb-4bcf-8c8b-a5f0bb481ac8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:25.466925 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-226b8732-8cbb-4bcf-8c8b-a5f0bb481ac8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:25.467348 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-226b8732-8cbb-4bcf-8c8b-a5f0bb481ac8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:25.468008 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-226b8732-8cbb-4bcf-8c8b-a5f0bb481ac8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:25.468719 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-226b8732-8cbb-4bcf-8c8b-a5f0bb481ac8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:25.469438 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-226b8732-8cbb-4bcf-8c8b-a5f0bb481ac8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:25.476581 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:21:25.650345 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-62ad91a9-373a-4e02-bdf5-47f8b5cff82c tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:25.658416 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-62ad91a9-373a-4e02-bdf5-47f8b5cff82c tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1261 microversion: 2.1 time: 0.215236 Aug 09 11:21:25.659003 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 277/521] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:25 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1261 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:25.664915 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-acc1a05e-b2e6-41fb-85de-f5b9726e4173 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:25.665752 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-acc1a05e-b2e6-41fb-85de-f5b9726e4173 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:25.680489 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-acc1a05e-b2e6-41fb-85de-f5b9726e4173 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:25.680489 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-acc1a05e-b2e6-41fb-85de-f5b9726e4173 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:25.680489 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-acc1a05e-b2e6-41fb-85de-f5b9726e4173 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:25.680489 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-acc1a05e-b2e6-41fb-85de-f5b9726e4173 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:25.680994 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-acc1a05e-b2e6-41fb-85de-f5b9726e4173 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:25.680994 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-acc1a05e-b2e6-41fb-85de-f5b9726e4173 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:25.684855 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-226b8732-8cbb-4bcf-8c8b-a5f0bb481ac8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:25.693149 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-226b8732-8cbb-4bcf-8c8b-a5f0bb481ac8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:25.695061 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-226b8732-8cbb-4bcf-8c8b-a5f0bb481ac8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:25.696758 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-226b8732-8cbb-4bcf-8c8b-a5f0bb481ac8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.241567 Aug 09 11:21:25.697302 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 245/522] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:21:25 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:21:25.790525 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-155bd9e0-6716-4453-b42d-735b7c97280a tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:25.791168 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-155bd9e0-6716-4453-b42d-735b7c97280a tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: eee55879-1bf3-41e4-b439-0c903100e828] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:25.797312 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-155bd9e0-6716-4453-b42d-735b7c97280a tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:25.797796 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-155bd9e0-6716-4453-b42d-735b7c97280a tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:25.798227 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-155bd9e0-6716-4453-b42d-735b7c97280a tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:25.798923 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-155bd9e0-6716-4453-b42d-735b7c97280a tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:25.799368 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-155bd9e0-6716-4453-b42d-735b7c97280a tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:25.799787 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-155bd9e0-6716-4453-b42d-735b7c97280a tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:25.818173 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-acc1a05e-b2e6-41fb-85de-f5b9726e4173 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:25.826714 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-acc1a05e-b2e6-41fb-85de-f5b9726e4173 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.166523 Aug 09 11:21:25.827383 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 278/523] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:25 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:25.936610 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-155bd9e0-6716-4453-b42d-735b7c97280a tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:25.944096 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-155bd9e0-6716-4453-b42d-735b7c97280a tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828" status: 200 len: 1682 microversion: 2.1 time: 0.157677 Aug 09 11:21:25.944886 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 246/524] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:25 2022] GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:26.040929 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-1c3777c5-79d8-4314-8a86-c981936507ea tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:26.041432 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-1c3777c5-79d8-4314-8a86-c981936507ea tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] [instance: 14c1cdbe-3b15-499a-88b5-7f86dfc5501b] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:26.047862 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1c3777c5-79d8-4314-8a86-c981936507ea tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:26.048371 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1c3777c5-79d8-4314-8a86-c981936507ea tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:26.048800 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1c3777c5-79d8-4314-8a86-c981936507ea tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:26.049474 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1c3777c5-79d8-4314-8a86-c981936507ea tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:26.049918 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1c3777c5-79d8-4314-8a86-c981936507ea tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:26.050337 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1c3777c5-79d8-4314-8a86-c981936507ea tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:26.180969 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.objects.instance [None req-1c3777c5-79d8-4314-8a86-c981936507ea tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lazy-loading 'services' on Instance uuid 14c1cdbe-3b15-499a-88b5-7f86dfc5501b {{(pid=117685) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:21:26.293155 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-1c3777c5-79d8-4314-8a86-c981936507ea tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] 10.222.0.27 "DELETE /compute/v2.1/servers/14c1cdbe-3b15-499a-88b5-7f86dfc5501b/os-volume_attachments/d0b58cbb-9df2-4aba-b2b6-99d0062dfae7" status: 202 len: 0 microversion: 2.1 time: 0.256054 Aug 09 11:21:26.293897 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 279/525] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Aug 9 11:21:26 2022] DELETE /compute/v2.1/servers/14c1cdbe-3b15-499a-88b5-7f86dfc5501b/os-volume_attachments/d0b58cbb-9df2-4aba-b2b6-99d0062dfae7 => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:21:26.678269 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-ba94ec78-2e45-405b-93cd-96a5331b1cc0 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:26.678857 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-ba94ec78-2e45-405b-93cd-96a5331b1cc0 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:26.681393 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_api:SELECT=80 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:21:26.686813 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ba94ec78-2e45-405b-93cd-96a5331b1cc0 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:26.687283 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ba94ec78-2e45-405b-93cd-96a5331b1cc0 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:26.687702 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ba94ec78-2e45-405b-93cd-96a5331b1cc0 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:26.688412 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ba94ec78-2e45-405b-93cd-96a5331b1cc0 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:26.688835 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ba94ec78-2e45-405b-93cd-96a5331b1cc0 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:26.689241 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ba94ec78-2e45-405b-93cd-96a5331b1cc0 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:26.720083 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-c36b083d-1d28-4949-98bc-949140f9d503 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:26.720814 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-c36b083d-1d28-4949-98bc-949140f9d503 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:26.728720 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c36b083d-1d28-4949-98bc-949140f9d503 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:26.729206 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c36b083d-1d28-4949-98bc-949140f9d503 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:26.729633 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c36b083d-1d28-4949-98bc-949140f9d503 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:26.730325 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c36b083d-1d28-4949-98bc-949140f9d503 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:26.730768 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c36b083d-1d28-4949-98bc-949140f9d503 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:26.731182 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c36b083d-1d28-4949-98bc-949140f9d503 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:26.879344 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-ba94ec78-2e45-405b-93cd-96a5331b1cc0 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:26.888236 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-ba94ec78-2e45-405b-93cd-96a5331b1cc0 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1261 microversion: 2.1 time: 0.213774 Aug 09 11:21:26.889445 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 247/526] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:26 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1261 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:26.894325 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-b95079c9-1900-4d8a-83df-646c7582bea3 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:26.894957 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-b95079c9-1900-4d8a-83df-646c7582bea3 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:26.903995 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b95079c9-1900-4d8a-83df-646c7582bea3 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:26.904641 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b95079c9-1900-4d8a-83df-646c7582bea3 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:26.905178 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b95079c9-1900-4d8a-83df-646c7582bea3 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:26.906793 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b95079c9-1900-4d8a-83df-646c7582bea3 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:26.907272 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b95079c9-1900-4d8a-83df-646c7582bea3 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:26.907702 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b95079c9-1900-4d8a-83df-646c7582bea3 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:26.909359 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-c36b083d-1d28-4949-98bc-949140f9d503 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:26.918990 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-c36b083d-1d28-4949-98bc-949140f9d503 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:26.921027 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-c36b083d-1d28-4949-98bc-949140f9d503 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:26.922506 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-c36b083d-1d28-4949-98bc-949140f9d503 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.206909 Aug 09 11:21:26.923293 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 280/527] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:21:26 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:21:26.966175 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-72b9148c-20f7-49b4-b795-7b567ce981ce tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:26.967007 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-72b9148c-20f7-49b4-b795-7b567ce981ce tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: eee55879-1bf3-41e4-b439-0c903100e828] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:26.973484 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-72b9148c-20f7-49b4-b795-7b567ce981ce tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:26.973976 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-72b9148c-20f7-49b4-b795-7b567ce981ce tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:26.974407 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-72b9148c-20f7-49b4-b795-7b567ce981ce tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:26.975117 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-72b9148c-20f7-49b4-b795-7b567ce981ce tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:26.975563 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-72b9148c-20f7-49b4-b795-7b567ce981ce tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:26.976095 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-72b9148c-20f7-49b4-b795-7b567ce981ce tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:27.117802 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-b95079c9-1900-4d8a-83df-646c7582bea3 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:27.126200 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-b95079c9-1900-4d8a-83df-646c7582bea3 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.235697 Aug 09 11:21:27.126765 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 248/528] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:26 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:27.160640 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-72b9148c-20f7-49b4-b795-7b567ce981ce tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:27.171021 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-72b9148c-20f7-49b4-b795-7b567ce981ce tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828" status: 200 len: 1682 microversion: 2.1 time: 0.208781 Aug 09 11:21:27.171594 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 281/529] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:26 2022] GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828 => generated 1682 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:27.912926 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-0dd33617-c546-4860-96d7-510de6d2ad87 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:27.913864 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-0dd33617-c546-4860-96d7-510de6d2ad87 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:27.924816 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0dd33617-c546-4860-96d7-510de6d2ad87 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:27.925563 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0dd33617-c546-4860-96d7-510de6d2ad87 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:27.926236 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0dd33617-c546-4860-96d7-510de6d2ad87 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:27.927294 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0dd33617-c546-4860-96d7-510de6d2ad87 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:27.927990 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0dd33617-c546-4860-96d7-510de6d2ad87 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:27.928684 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0dd33617-c546-4860-96d7-510de6d2ad87 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:27.952592 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-68301fbe-ad35-4fd2-8192-5cb30b767f36 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:27.953107 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-68301fbe-ad35-4fd2-8192-5cb30b767f36 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:27.960490 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-68301fbe-ad35-4fd2-8192-5cb30b767f36 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:27.961177 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-68301fbe-ad35-4fd2-8192-5cb30b767f36 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:27.961600 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-68301fbe-ad35-4fd2-8192-5cb30b767f36 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:27.962299 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-68301fbe-ad35-4fd2-8192-5cb30b767f36 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:27.962743 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-68301fbe-ad35-4fd2-8192-5cb30b767f36 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:27.963350 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-68301fbe-ad35-4fd2-8192-5cb30b767f36 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:28.141715 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-0dd33617-c546-4860-96d7-510de6d2ad87 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:28.146156 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-68301fbe-ad35-4fd2-8192-5cb30b767f36 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:28.151328 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-0dd33617-c546-4860-96d7-510de6d2ad87 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1445 microversion: 2.1 time: 0.243904 Aug 09 11:21:28.152222 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 249/530] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:27 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1445 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:28.156664 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-17e3c0d5-f8c9-4dab-92e3-3ec06db976a9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:28.157255 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-17e3c0d5-f8c9-4dab-92e3-3ec06db976a9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:28.158487 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-68301fbe-ad35-4fd2-8192-5cb30b767f36 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:28.159995 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-68301fbe-ad35-4fd2-8192-5cb30b767f36 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:28.161230 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-68301fbe-ad35-4fd2-8192-5cb30b767f36 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.215484 Aug 09 11:21:28.162016 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 282/531] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:21:27 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:21:28.167019 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-17e3c0d5-f8c9-4dab-92e3-3ec06db976a9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:28.167513 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-17e3c0d5-f8c9-4dab-92e3-3ec06db976a9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:28.167951 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-17e3c0d5-f8c9-4dab-92e3-3ec06db976a9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:28.168729 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-17e3c0d5-f8c9-4dab-92e3-3ec06db976a9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:28.169318 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-17e3c0d5-f8c9-4dab-92e3-3ec06db976a9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:28.169752 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-17e3c0d5-f8c9-4dab-92e3-3ec06db976a9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:28.172662 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-175f7a54-1204-4ecb-bc77-5095460014b7 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:28.173416 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-175f7a54-1204-4ecb-bc77-5095460014b7 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:28.179895 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-175f7a54-1204-4ecb-bc77-5095460014b7 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:28.180470 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-175f7a54-1204-4ecb-bc77-5095460014b7 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:28.180898 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-175f7a54-1204-4ecb-bc77-5095460014b7 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:28.181594 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-175f7a54-1204-4ecb-bc77-5095460014b7 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:28.182038 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-175f7a54-1204-4ecb-bc77-5095460014b7 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:28.182452 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-175f7a54-1204-4ecb-bc77-5095460014b7 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:28.370631 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-17e3c0d5-f8c9-4dab-92e3-3ec06db976a9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:28.374341 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-175f7a54-1204-4ecb-bc77-5095460014b7 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:28.378937 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-17e3c0d5-f8c9-4dab-92e3-3ec06db976a9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.225713 Aug 09 11:21:28.379520 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 250/532] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:28 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:28.382098 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-175f7a54-1204-4ecb-bc77-5095460014b7 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1445 microversion: 2.1 time: 0.213806 Aug 09 11:21:28.382652 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 283/533] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:28 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1445 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:28.384043 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-185281be-20f3-476e-913b-c9ea76715002 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:28.384671 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-185281be-20f3-476e-913b-c9ea76715002 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: eee55879-1bf3-41e4-b439-0c903100e828] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:28.390502 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-185281be-20f3-476e-913b-c9ea76715002 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:28.390977 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-185281be-20f3-476e-913b-c9ea76715002 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:28.391401 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-185281be-20f3-476e-913b-c9ea76715002 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:28.392483 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-185281be-20f3-476e-913b-c9ea76715002 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:28.392924 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-185281be-20f3-476e-913b-c9ea76715002 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:28.393340 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-185281be-20f3-476e-913b-c9ea76715002 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:28.411484 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell1:SELECT=100 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:21:28.540352 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-185281be-20f3-476e-913b-c9ea76715002 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:28.548744 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-185281be-20f3-476e-913b-c9ea76715002 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828" status: 200 len: 1682 microversion: 2.1 time: 0.168220 Aug 09 11:21:28.560286 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 251/534] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:28 2022] GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:29.185739 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-5aa49c14-799a-4b34-89c5-535666fbee1b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:29.186394 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-5aa49c14-799a-4b34-89c5-535666fbee1b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:29.193835 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5aa49c14-799a-4b34-89c5-535666fbee1b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:29.194460 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5aa49c14-799a-4b34-89c5-535666fbee1b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:29.194857 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5aa49c14-799a-4b34-89c5-535666fbee1b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:29.195869 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5aa49c14-799a-4b34-89c5-535666fbee1b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:29.196312 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5aa49c14-799a-4b34-89c5-535666fbee1b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:29.196867 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5aa49c14-799a-4b34-89c5-535666fbee1b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:29.400843 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-6b54cc1f-d180-4748-9d6e-ade5bc8b45c6 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:29.401978 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-6b54cc1f-d180-4748-9d6e-ade5bc8b45c6 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:29.409164 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6b54cc1f-d180-4748-9d6e-ade5bc8b45c6 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:29.409817 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6b54cc1f-d180-4748-9d6e-ade5bc8b45c6 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:29.410405 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6b54cc1f-d180-4748-9d6e-ade5bc8b45c6 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:29.411257 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6b54cc1f-d180-4748-9d6e-ade5bc8b45c6 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:29.411878 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6b54cc1f-d180-4748-9d6e-ade5bc8b45c6 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:29.412470 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6b54cc1f-d180-4748-9d6e-ade5bc8b45c6 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:29.421918 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-5aa49c14-799a-4b34-89c5-535666fbee1b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:29.432834 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-5aa49c14-799a-4b34-89c5-535666fbee1b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:29.434470 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-5aa49c14-799a-4b34-89c5-535666fbee1b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:29.435650 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-5aa49c14-799a-4b34-89c5-535666fbee1b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.254892 Aug 09 11:21:29.436418 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 284/535] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:21:29 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:21:29.575016 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-46767525-76e2-4194-a997-1dcfb217d8af tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:29.575613 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-46767525-76e2-4194-a997-1dcfb217d8af tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: eee55879-1bf3-41e4-b439-0c903100e828] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:29.581617 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-46767525-76e2-4194-a997-1dcfb217d8af tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:29.582070 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-46767525-76e2-4194-a997-1dcfb217d8af tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:29.582684 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-46767525-76e2-4194-a997-1dcfb217d8af tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:29.583378 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-46767525-76e2-4194-a997-1dcfb217d8af tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:29.583819 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-46767525-76e2-4194-a997-1dcfb217d8af tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:29.584229 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-46767525-76e2-4194-a997-1dcfb217d8af tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:29.921099 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-6b54cc1f-d180-4748-9d6e-ade5bc8b45c6 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:29.930172 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-6b54cc1f-d180-4748-9d6e-ade5bc8b45c6 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1502 microversion: 2.1 time: 0.533086 Aug 09 11:21:29.930821 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 252/536] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:29 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1502 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:21:29.951119 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-9cb8660a-035c-42aa-9276-0603aebe2a59 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ded276a5-d75a-4c07-9168-1ee85f9fcf98"}} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:21:29.953625 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-9cb8660a-035c-42aa-9276-0603aebe2a59 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:29.960101 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9cb8660a-035c-42aa-9276-0603aebe2a59 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:29.960657 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9cb8660a-035c-42aa-9276-0603aebe2a59 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:29.961325 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9cb8660a-035c-42aa-9276-0603aebe2a59 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:29.962082 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9cb8660a-035c-42aa-9276-0603aebe2a59 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:29.962529 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9cb8660a-035c-42aa-9276-0603aebe2a59 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:29.962943 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9cb8660a-035c-42aa-9276-0603aebe2a59 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:29.987528 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.wsgi [None req-9cb8660a-035c-42aa-9276-0603aebe2a59 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] HTTP exception thrown: Cannot 'attach_volume' instance 41447c00-5903-4495-9529-ec080a0840c1 while it is in vm_state rescued Aug 09 11:21:29.989567 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-9cb8660a-035c-42aa-9276-0603aebe2a59 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Request method failure captured: Aug 09 11:21:29.989567 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: request: POST /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1/os-volume_attachments HTTP/1.1 Aug 09 11:21:29.989567 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept: application/json Aug 09 11:21:29.989567 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept-Encoding: identity Aug 09 11:21:29.989567 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Connection: close Aug 09 11:21:29.989567 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Length: 74 Aug 09 11:21:29.989567 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Type: application/json Aug 09 11:21:29.989567 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Host: 10.222.0.27 Aug 09 11:21:29.989567 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Openstack-System-Scope: None Aug 09 11:21:29.989567 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: User-Agent: python-urllib3/1.26.11 Aug 09 11:21:29.989567 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Auth-Token: gAAAAABi8kK4ZURPQKT-E-bhJo1FLIIqaFjoTaLi0t_9gs19mh3N7gqZ6GeAerCuuiTJe0dYAhdQ2iR_bfI_b0ZwFkvbIx4r8Jm4-7nh0tWhT2kBjRkOHrLdvaHoe9ZT_a_-HZxYdn72f859LpQhFNf_Fvg_jqnrIaRWCS_QgEMwXjTJVjY3_8I Aug 09 11:21:29.989567 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Id: None Aug 09 11:21:29.989567 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Name: None Aug 09 11:21:29.989567 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Identity-Status: Confirmed Aug 09 11:21:29.989567 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Is-Admin-Project: True Aug 09 11:21:29.989567 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Id: default Aug 09 11:21:29.989567 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Name: Default Aug 09 11:21:29.989567 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Id: 45bb3a603ddc4d3b8042b6ae687c896e Aug 09 11:21:29.989567 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-338750798 Aug 09 11:21:29.989567 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Role: member,reader Aug 09 11:21:29.989567 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Roles: member,reader Aug 09 11:21:29.990841 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/45bb3a603ddc4d3b8042b6ae687c896e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_45bb3a603ddc4d3b8042b6ae687c896e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/45bb3a603ddc4d3b8042b6ae687c896e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/45bb3a603ddc4d3b8042b6ae687c896e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:21:29.990841 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant: tempest-ServerRescueNegativeTestJSON-338750798 Aug 09 11:21:29.990841 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Id: 45bb3a603ddc4d3b8042b6ae687c896e Aug 09 11:21:29.990841 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-338750798 Aug 09 11:21:29.990841 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User: tempest-ServerRescueNegativeTestJSON-338750798-project Aug 09 11:21:29.990841 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Id: default Aug 09 11:21:29.990841 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Name: Default Aug 09 11:21:29.990841 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Id: 3a1cd35a257f4b0f99141580c14bad48 Aug 09 11:21:29.990841 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Name: tempest-ServerRescueNegativeTestJSON-338750798-project Aug 09 11:21:29.990841 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Aug 09 11:21:29.990841 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: {"volumeAttachment": {"volumeId": "ded276a5-d75a-4c07-9168-1ee85f9fcf98"}} Aug 09 11:21:29.990841 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: method: > Aug 09 11:21:29.991605 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: exception: Cannot 'attach_volume' instance 41447c00-5903-4495-9529-ec080a0840c1 while it is in vm_state rescued Aug 09 11:21:29.991605 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: action_args: {'server_id': '41447c00-5903-4495-9529-ec080a0840c1', 'body': {'volumeAttachment': {'volumeId': 'ded276a5-d75a-4c07-9168-1ee85f9fcf98'}}} Aug 09 11:21:29.991605 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:21:29.991605 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:21:29.991605 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 09 11:21:29.991605 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 09 11:21:29.991605 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 11:21:29.991605 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 11:21:29.991605 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 09 11:21:29.991605 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 09 11:21:29.991605 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 41447c00-5903-4495-9529-ec080a0840c1 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 09 11:21:29.991605 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:21:29.991605 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:21:29.991605 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:21:29.991605 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:21:29.991605 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:21:29.991605 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:21:29.991605 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:21:29.991605 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:21:29.993245 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:21:29.993245 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:21:29.993245 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 11:21:29.993245 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 11:21:29.993245 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 11:21:29.993245 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 11:21:29.993245 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 11:21:29.993245 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 11:21:29.993245 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 09 11:21:29.993245 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 09 11:21:29.993245 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 09 11:21:29.993245 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 11:21:29.993245 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 41447c00-5903-4495-9529-ec080a0840c1 while it is in vm_state rescued Aug 09 11:21:29.993245 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:21:29.993245 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:21:29.993245 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:21:29.993245 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:21:29.993245 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:21:29.993245 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:21:29.994576 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:21:29.994576 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:21:29.994576 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 41447c00-5903-4495-9529-ec080a0840c1 while it is in vm_state rescued Aug 09 11:21:29.994576 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:21:29.994576 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-9cb8660a-035c-42aa-9276-0603aebe2a59 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Returning 409 to user: Cannot 'attach_volume' instance 41447c00-5903-4495-9529-ec080a0840c1 while it is in vm_state rescued {{(pid=117684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:21:29.994576 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-9cb8660a-035c-42aa-9276-0603aebe2a59 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "POST /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044030 Aug 09 11:21:29.994576 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 253/537] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Aug 9 11:21:29 2022] POST /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 11:21:30.000834 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-63efbc3c-f6d5-4784-b5e6-b43d935f1ead tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:21:30.001429 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-63efbc3c-f6d5-4784-b5e6-b43d935f1ead tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:30.008012 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-63efbc3c-f6d5-4784-b5e6-b43d935f1ead tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:30.008531 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-63efbc3c-f6d5-4784-b5e6-b43d935f1ead tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:30.008973 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-63efbc3c-f6d5-4784-b5e6-b43d935f1ead tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:30.009650 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-63efbc3c-f6d5-4784-b5e6-b43d935f1ead tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:30.010090 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-63efbc3c-f6d5-4784-b5e6-b43d935f1ead tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:30.010503 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-63efbc3c-f6d5-4784-b5e6-b43d935f1ead tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:30.066090 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-46767525-76e2-4194-a997-1dcfb217d8af tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:30.075321 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-46767525-76e2-4194-a997-1dcfb217d8af tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828" status: 200 len: 1682 microversion: 2.1 time: 0.504041 Aug 09 11:21:30.076045 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 285/538] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:29 2022] GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828 => generated 1682 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:30.088698 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-63efbc3c-f6d5-4784-b5e6-b43d935f1ead tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "POST /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1/action" status: 202 len: 0 microversion: 2.1 time: 0.084001 Aug 09 11:21:30.088698 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 254/539] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 9 11:21:29 2022] POST /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:21:30.095463 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-ea157db3-255b-4ed9-bead-74647c980120 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:30.096237 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-ea157db3-255b-4ed9-bead-74647c980120 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:30.103327 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ea157db3-255b-4ed9-bead-74647c980120 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:30.103808 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ea157db3-255b-4ed9-bead-74647c980120 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:30.104240 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ea157db3-255b-4ed9-bead-74647c980120 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:30.104963 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ea157db3-255b-4ed9-bead-74647c980120 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:30.105410 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ea157db3-255b-4ed9-bead-74647c980120 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:30.105831 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ea157db3-255b-4ed9-bead-74647c980120 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:30.340764 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-ea157db3-255b-4ed9-bead-74647c980120 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:30.349340 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-ea157db3-255b-4ed9-bead-74647c980120 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1510 microversion: 2.1 time: 0.259053 Aug 09 11:21:30.350405 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 255/540] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:30 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1510 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:30.458862 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-7e9df488-4ab6-4472-8c14-10c9d4bb049c tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:30.459399 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-7e9df488-4ab6-4472-8c14-10c9d4bb049c tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:30.466288 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7e9df488-4ab6-4472-8c14-10c9d4bb049c tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:30.466781 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7e9df488-4ab6-4472-8c14-10c9d4bb049c tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:30.467345 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7e9df488-4ab6-4472-8c14-10c9d4bb049c tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:30.468090 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7e9df488-4ab6-4472-8c14-10c9d4bb049c tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:30.468754 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7e9df488-4ab6-4472-8c14-10c9d4bb049c tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:30.469197 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7e9df488-4ab6-4472-8c14-10c9d4bb049c tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:30.701776 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-7e9df488-4ab6-4472-8c14-10c9d4bb049c tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:30.711093 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-7e9df488-4ab6-4472-8c14-10c9d4bb049c tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:30.713456 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-7e9df488-4ab6-4472-8c14-10c9d4bb049c tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:30.715172 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-7e9df488-4ab6-4472-8c14-10c9d4bb049c tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.260231 Aug 09 11:21:30.715944 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 286/541] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:21:30 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:21:30.912129 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [req-d1ad1183-7fc0-4cbb-9729-7968ccf8a297 req-1bc14d25-abb7-42ff-b77f-a31c504494a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b683e1f9-1d37-46d4-a7a1-9f15b514336e", "tag": "afc665af-24eb-4ff3-8263-bd971e0a7488"}]} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:21:30.932041 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-d1ad1183-7fc0-4cbb-9729-7968ccf8a297 req-1bc14d25-abb7-42ff-b77f-a31c504494a5 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:30.932774 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-d1ad1183-7fc0-4cbb-9729-7968ccf8a297 req-1bc14d25-abb7-42ff-b77f-a31c504494a5 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:30.933195 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-d1ad1183-7fc0-4cbb-9729-7968ccf8a297 req-1bc14d25-abb7-42ff-b77f-a31c504494a5 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:30.951987 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.compute.server_external_events [req-d1ad1183-7fc0-4cbb-9729-7968ccf8a297 req-1bc14d25-abb7-42ff-b77f-a31c504494a5 service nova] Creating event network-changed:afc665af-24eb-4ff3-8263-bd971e0a7488 for instance b683e1f9-1d37-46d4-a7a1-9f15b514336e on hv-cinder-85251 Aug 09 11:21:30.957098 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [req-d1ad1183-7fc0-4cbb-9729-7968ccf8a297 req-1bc14d25-abb7-42ff-b77f-a31c504494a5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052583 Aug 09 11:21:30.958546 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 256/542] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:21:31.098777 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-efaefccc-1466-400e-9a9c-f35fce04ab21 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:31.099388 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-efaefccc-1466-400e-9a9c-f35fce04ab21 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: eee55879-1bf3-41e4-b439-0c903100e828] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:31.106004 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-efaefccc-1466-400e-9a9c-f35fce04ab21 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:31.106508 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-efaefccc-1466-400e-9a9c-f35fce04ab21 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:31.107152 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-efaefccc-1466-400e-9a9c-f35fce04ab21 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:31.107853 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-efaefccc-1466-400e-9a9c-f35fce04ab21 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:31.108452 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-efaefccc-1466-400e-9a9c-f35fce04ab21 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:31.108875 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-efaefccc-1466-400e-9a9c-f35fce04ab21 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:31.371463 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-d5a9d14a-7134-4dcd-aa7c-c9dcf1a0353d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:31.372492 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-d5a9d14a-7134-4dcd-aa7c-c9dcf1a0353d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:31.384663 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d5a9d14a-7134-4dcd-aa7c-c9dcf1a0353d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:31.387252 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d5a9d14a-7134-4dcd-aa7c-c9dcf1a0353d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:31.388788 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d5a9d14a-7134-4dcd-aa7c-c9dcf1a0353d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:31.390555 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d5a9d14a-7134-4dcd-aa7c-c9dcf1a0353d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:31.391430 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-efaefccc-1466-400e-9a9c-f35fce04ab21 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:31.395254 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d5a9d14a-7134-4dcd-aa7c-c9dcf1a0353d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:31.395982 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d5a9d14a-7134-4dcd-aa7c-c9dcf1a0353d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:31.409872 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-efaefccc-1466-400e-9a9c-f35fce04ab21 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828" status: 200 len: 1682 microversion: 2.1 time: 0.312777 Aug 09 11:21:31.431455 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 287/543] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:31 2022] GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828 => generated 1682 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:31.750946 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-8367e737-827d-464a-b87f-a8e61df34e33 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:31.751724 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-8367e737-827d-464a-b87f-a8e61df34e33 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:31.759163 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8367e737-827d-464a-b87f-a8e61df34e33 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:31.759801 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8367e737-827d-464a-b87f-a8e61df34e33 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:31.760295 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8367e737-827d-464a-b87f-a8e61df34e33 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:31.760941 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8367e737-827d-464a-b87f-a8e61df34e33 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:31.761708 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8367e737-827d-464a-b87f-a8e61df34e33 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:31.762474 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8367e737-827d-464a-b87f-a8e61df34e33 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:31.778876 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-d5a9d14a-7134-4dcd-aa7c-c9dcf1a0353d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:31.788553 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-d5a9d14a-7134-4dcd-aa7c-c9dcf1a0353d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1510 microversion: 2.1 time: 0.421233 Aug 09 11:21:31.789156 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 257/544] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:31 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1510 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:21:32.059557 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-8367e737-827d-464a-b87f-a8e61df34e33 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:32.080197 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-8367e737-827d-464a-b87f-a8e61df34e33 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:32.083034 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-8367e737-827d-464a-b87f-a8e61df34e33 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:32.084566 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-8367e737-827d-464a-b87f-a8e61df34e33 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.340076 Aug 09 11:21:32.085741 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 288/545] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:21:31 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:21:32.439603 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-1e6a3037-62ab-423f-954f-71c0d219ae62 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:32.440988 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-1e6a3037-62ab-423f-954f-71c0d219ae62 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: eee55879-1bf3-41e4-b439-0c903100e828] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:32.450188 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1e6a3037-62ab-423f-954f-71c0d219ae62 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:32.451066 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1e6a3037-62ab-423f-954f-71c0d219ae62 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:32.451709 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1e6a3037-62ab-423f-954f-71c0d219ae62 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:32.452772 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1e6a3037-62ab-423f-954f-71c0d219ae62 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:32.453453 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1e6a3037-62ab-423f-954f-71c0d219ae62 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:32.454131 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1e6a3037-62ab-423f-954f-71c0d219ae62 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:32.547834 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-1e6a3037-62ab-423f-954f-71c0d219ae62 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:32.556958 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-1e6a3037-62ab-423f-954f-71c0d219ae62 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828" status: 200 len: 1615 microversion: 2.1 time: 0.121368 Aug 09 11:21:32.578540 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 258/546] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:32 2022] GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828 => generated 1615 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:32.810130 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-d6006b74-04ca-40ff-ba65-59eddbe68bff tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:32.810742 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-d6006b74-04ca-40ff-ba65-59eddbe68bff tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:32.834127 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d6006b74-04ca-40ff-ba65-59eddbe68bff tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:32.834751 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d6006b74-04ca-40ff-ba65-59eddbe68bff tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:32.835199 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d6006b74-04ca-40ff-ba65-59eddbe68bff tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:32.839632 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d6006b74-04ca-40ff-ba65-59eddbe68bff tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:32.840393 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d6006b74-04ca-40ff-ba65-59eddbe68bff tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:32.840993 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d6006b74-04ca-40ff-ba65-59eddbe68bff tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:32.867928 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-6cf1148b-16aa-4c6b-8afb-2aa30b51d3e5 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:32.869396 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-6cf1148b-16aa-4c6b-8afb-2aa30b51d3e5 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] [instance: 14c1cdbe-3b15-499a-88b5-7f86dfc5501b] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:32.882013 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6cf1148b-16aa-4c6b-8afb-2aa30b51d3e5 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:32.882518 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6cf1148b-16aa-4c6b-8afb-2aa30b51d3e5 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:32.883102 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6cf1148b-16aa-4c6b-8afb-2aa30b51d3e5 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:32.883813 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6cf1148b-16aa-4c6b-8afb-2aa30b51d3e5 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:32.884257 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6cf1148b-16aa-4c6b-8afb-2aa30b51d3e5 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:32.884702 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6cf1148b-16aa-4c6b-8afb-2aa30b51d3e5 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:32.941192 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-6cf1148b-16aa-4c6b-8afb-2aa30b51d3e5 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] [instance: 14c1cdbe-3b15-499a-88b5-7f86dfc5501b] Going to try to terminate instance {{(pid=117684) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 11:21:33.140559 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-6cf1148b-16aa-4c6b-8afb-2aa30b51d3e5 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] 10.222.0.27 "DELETE /compute/v2.1/servers/14c1cdbe-3b15-499a-88b5-7f86dfc5501b" status: 204 len: 0 microversion: 2.1 time: 0.265692 Aug 09 11:21:33.140559 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 259/547] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 9 11:21:32 2022] DELETE /compute/v2.1/servers/14c1cdbe-3b15-499a-88b5-7f86dfc5501b => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 11:21:33.140559 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [req-5284ab70-c678-48af-8f4b-f138dab3c158 req-5a396b33-0233-4bf7-be40-7240152d5d1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eee55879-1bf3-41e4-b439-0c903100e828", "name": "network-vif-deleted", "tag": "e6897a01-7b9e-4865-b51f-2d3190ae1e3a"}]} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:21:33.161350 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-5284ab70-c678-48af-8f4b-f138dab3c158 req-5a396b33-0233-4bf7-be40-7240152d5d1f service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:33.162128 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-5284ab70-c678-48af-8f4b-f138dab3c158 req-5a396b33-0233-4bf7-be40-7240152d5d1f service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:33.163318 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-5284ab70-c678-48af-8f4b-f138dab3c158 req-5a396b33-0233-4bf7-be40-7240152d5d1f service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:33.177927 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-d6006b74-04ca-40ff-ba65-59eddbe68bff tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:33.187992 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-d6006b74-04ca-40ff-ba65-59eddbe68bff tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1510 microversion: 2.1 time: 0.381683 Aug 09 11:21:33.189034 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 289/548] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:32 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1510 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:33.190303 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.compute.server_external_events [req-5284ab70-c678-48af-8f4b-f138dab3c158 req-5a396b33-0233-4bf7-be40-7240152d5d1f service nova] Creating event network-vif-deleted:e6897a01-7b9e-4865-b51f-2d3190ae1e3a for instance eee55879-1bf3-41e4-b439-0c903100e828 on hv-cinder-85251 Aug 09 11:21:33.196205 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [req-5284ab70-c678-48af-8f4b-f138dab3c158 req-5a396b33-0233-4bf7-be40-7240152d5d1f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064682 Aug 09 11:21:33.197044 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 260/549] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:21:33.203603 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-e5ba8629-df11-41b2-9dbe-d9998200cd71 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:33.204523 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-e5ba8629-df11-41b2-9dbe-d9998200cd71 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] [instance: 14c1cdbe-3b15-499a-88b5-7f86dfc5501b] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:33.206155 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-8c3336b6-0a94-4252-95aa-d1fcbe1fa0f5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:33.206886 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-8c3336b6-0a94-4252-95aa-d1fcbe1fa0f5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:33.212553 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e5ba8629-df11-41b2-9dbe-d9998200cd71 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:33.213267 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e5ba8629-df11-41b2-9dbe-d9998200cd71 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:33.213857 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e5ba8629-df11-41b2-9dbe-d9998200cd71 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:33.215092 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e5ba8629-df11-41b2-9dbe-d9998200cd71 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:33.215906 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e5ba8629-df11-41b2-9dbe-d9998200cd71 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:33.216534 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e5ba8629-df11-41b2-9dbe-d9998200cd71 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:33.217099 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8c3336b6-0a94-4252-95aa-d1fcbe1fa0f5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:33.217678 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8c3336b6-0a94-4252-95aa-d1fcbe1fa0f5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:33.218202 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8c3336b6-0a94-4252-95aa-d1fcbe1fa0f5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:33.218989 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8c3336b6-0a94-4252-95aa-d1fcbe1fa0f5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:33.219715 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8c3336b6-0a94-4252-95aa-d1fcbe1fa0f5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:33.220501 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8c3336b6-0a94-4252-95aa-d1fcbe1fa0f5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:33.444500 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-e5ba8629-df11-41b2-9dbe-d9998200cd71 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff3135cc1482461caf69068b659f49e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2f6acb3c3a4b24be797a677d868227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:33.456691 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-8c3336b6-0a94-4252-95aa-d1fcbe1fa0f5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:33.461767 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-e5ba8629-df11-41b2-9dbe-d9998200cd71 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] 10.222.0.27 "GET /compute/v2.1/servers/14c1cdbe-3b15-499a-88b5-7f86dfc5501b" status: 200 len: 1513 microversion: 2.1 time: 0.263301 Aug 09 11:21:33.462323 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 261/550] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:33 2022] GET /compute/v2.1/servers/14c1cdbe-3b15-499a-88b5-7f86dfc5501b => generated 1513 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:33.469646 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-2c263284-8a19-4c8a-bda4-74153e30d0fb tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:21:33.476147 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-8c3336b6-0a94-4252-95aa-d1fcbe1fa0f5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:33.477797 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-8c3336b6-0a94-4252-95aa-d1fcbe1fa0f5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:33.481538 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-8c3336b6-0a94-4252-95aa-d1fcbe1fa0f5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.290497 Aug 09 11:21:33.483540 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 290/551] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:21:33 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:21:33.486677 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2c263284-8a19-4c8a-bda4-74153e30d0fb tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:33.487229 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2c263284-8a19-4c8a-bda4-74153e30d0fb tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:33.487723 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2c263284-8a19-4c8a-bda4-74153e30d0fb tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:33.552786 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-2c263284-8a19-4c8a-bda4-74153e30d0fb tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Going to try to stop instance {{(pid=117684) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 09 11:21:33.597153 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-4f3e638e-0b8f-44dd-b435-9b757a794234 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:33.598285 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-4f3e638e-0b8f-44dd-b435-9b757a794234 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: eee55879-1bf3-41e4-b439-0c903100e828] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:33.606734 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4f3e638e-0b8f-44dd-b435-9b757a794234 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:33.607866 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4f3e638e-0b8f-44dd-b435-9b757a794234 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:33.608720 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4f3e638e-0b8f-44dd-b435-9b757a794234 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:33.610552 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4f3e638e-0b8f-44dd-b435-9b757a794234 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:33.611235 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4f3e638e-0b8f-44dd-b435-9b757a794234 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:33.611893 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4f3e638e-0b8f-44dd-b435-9b757a794234 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:33.612787 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-2c263284-8a19-4c8a-bda4-74153e30d0fb tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "POST /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f/action" status: 202 len: 0 microversion: 2.1 time: 0.146462 Aug 09 11:21:33.613773 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 262/552] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 9 11:21:33 2022] POST /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:21:33.626212 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-3030eaa9-9ba3-4834-883d-62c362c8ab47 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:33.627717 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-3030eaa9-9ba3-4834-883d-62c362c8ab47 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:33.634125 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3030eaa9-9ba3-4834-883d-62c362c8ab47 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:33.634605 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3030eaa9-9ba3-4834-883d-62c362c8ab47 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:33.635082 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3030eaa9-9ba3-4834-883d-62c362c8ab47 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:33.635783 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3030eaa9-9ba3-4834-883d-62c362c8ab47 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:33.636222 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3030eaa9-9ba3-4834-883d-62c362c8ab47 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:33.636654 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3030eaa9-9ba3-4834-883d-62c362c8ab47 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:33.667024 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4f3e638e-0b8f-44dd-b435-9b757a794234 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:33.667613 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4f3e638e-0b8f-44dd-b435-9b757a794234 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:33.668344 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4f3e638e-0b8f-44dd-b435-9b757a794234 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:33.668878 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.objects.instance [None req-4f3e638e-0b8f-44dd-b435-9b757a794234 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lazy-loading 'fault' on Instance uuid eee55879-1bf3-41e4-b439-0c903100e828 {{(pid=117685) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:21:33.735826 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-4f3e638e-0b8f-44dd-b435-9b757a794234 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:33.748104 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-4f3e638e-0b8f-44dd-b435-9b757a794234 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828" status: 200 len: 1332 microversion: 2.1 time: 0.156478 Aug 09 11:21:33.762124 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 291/553] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:33 2022] GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828 => generated 1332 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:21:33.808869 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-3030eaa9-9ba3-4834-883d-62c362c8ab47 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:33.816865 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-3030eaa9-9ba3-4834-883d-62c362c8ab47 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1677 microversion: 2.1 time: 0.195566 Aug 09 11:21:33.817451 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 263/554] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:33 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1677 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:34.214040 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-e4f34086-cdb1-48ba-ac4e-2bbafab3a321 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:34.214689 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-e4f34086-cdb1-48ba-ac4e-2bbafab3a321 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:34.221886 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e4f34086-cdb1-48ba-ac4e-2bbafab3a321 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:34.222748 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e4f34086-cdb1-48ba-ac4e-2bbafab3a321 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:34.223262 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e4f34086-cdb1-48ba-ac4e-2bbafab3a321 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:34.224067 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e4f34086-cdb1-48ba-ac4e-2bbafab3a321 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:34.224611 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e4f34086-cdb1-48ba-ac4e-2bbafab3a321 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:34.225108 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e4f34086-cdb1-48ba-ac4e-2bbafab3a321 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:34.372434 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-e4f34086-cdb1-48ba-ac4e-2bbafab3a321 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:34.380174 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-e4f34086-cdb1-48ba-ac4e-2bbafab3a321 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1510 microversion: 2.1 time: 0.170448 Aug 09 11:21:34.380771 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 292/555] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:34 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1510 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:34.483692 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-6d3d9fa5-068a-498a-af9b-7f2cf1ff7b6c tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:34.484539 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-6d3d9fa5-068a-498a-af9b-7f2cf1ff7b6c tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] [instance: 14c1cdbe-3b15-499a-88b5-7f86dfc5501b] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:34.492116 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6d3d9fa5-068a-498a-af9b-7f2cf1ff7b6c tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:34.492898 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6d3d9fa5-068a-498a-af9b-7f2cf1ff7b6c tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:34.494800 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6d3d9fa5-068a-498a-af9b-7f2cf1ff7b6c tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:34.495555 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6d3d9fa5-068a-498a-af9b-7f2cf1ff7b6c tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:34.496249 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6d3d9fa5-068a-498a-af9b-7f2cf1ff7b6c tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:34.496700 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6d3d9fa5-068a-498a-af9b-7f2cf1ff7b6c tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:34.506121 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-7dbf09aa-eaee-41b4-9288-0771bd58d302 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:34.507601 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-7dbf09aa-eaee-41b4-9288-0771bd58d302 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:34.514380 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7dbf09aa-eaee-41b4-9288-0771bd58d302 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:34.514874 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7dbf09aa-eaee-41b4-9288-0771bd58d302 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:34.515311 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7dbf09aa-eaee-41b4-9288-0771bd58d302 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:34.516058 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7dbf09aa-eaee-41b4-9288-0771bd58d302 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:34.516531 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7dbf09aa-eaee-41b4-9288-0771bd58d302 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:34.517474 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7dbf09aa-eaee-41b4-9288-0771bd58d302 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:34.521819 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:21:34.705307 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-6d3d9fa5-068a-498a-af9b-7f2cf1ff7b6c tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff3135cc1482461caf69068b659f49e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2f6acb3c3a4b24be797a677d868227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:34.708051 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-7dbf09aa-eaee-41b4-9288-0771bd58d302 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:34.713744 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-6d3d9fa5-068a-498a-af9b-7f2cf1ff7b6c tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] 10.222.0.27 "GET /compute/v2.1/servers/14c1cdbe-3b15-499a-88b5-7f86dfc5501b" status: 200 len: 1513 microversion: 2.1 time: 0.234845 Aug 09 11:21:34.714325 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 264/556] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:34 2022] GET /compute/v2.1/servers/14c1cdbe-3b15-499a-88b5-7f86dfc5501b => generated 1513 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:34.717094 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-7dbf09aa-eaee-41b4-9288-0771bd58d302 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:34.718608 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-7dbf09aa-eaee-41b4-9288-0771bd58d302 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:34.719763 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-7dbf09aa-eaee-41b4-9288-0771bd58d302 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.217697 Aug 09 11:21:34.720342 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 293/557] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:21:34 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:21:34.770731 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-9a160546-7a4a-4ef5-abcc-a19798da299c tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:34.771270 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-9a160546-7a4a-4ef5-abcc-a19798da299c tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: eee55879-1bf3-41e4-b439-0c903100e828] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:34.777707 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9a160546-7a4a-4ef5-abcc-a19798da299c tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:34.778188 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9a160546-7a4a-4ef5-abcc-a19798da299c tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:34.778622 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9a160546-7a4a-4ef5-abcc-a19798da299c tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:34.779308 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9a160546-7a4a-4ef5-abcc-a19798da299c tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:34.779757 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9a160546-7a4a-4ef5-abcc-a19798da299c tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:34.780186 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9a160546-7a4a-4ef5-abcc-a19798da299c tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:34.811517 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9a160546-7a4a-4ef5-abcc-a19798da299c tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:34.812020 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9a160546-7a4a-4ef5-abcc-a19798da299c tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:34.812497 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9a160546-7a4a-4ef5-abcc-a19798da299c tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:34.812945 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.objects.instance [None req-9a160546-7a4a-4ef5-abcc-a19798da299c tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lazy-loading 'fault' on Instance uuid eee55879-1bf3-41e4-b439-0c903100e828 {{(pid=117684) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:21:34.837763 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-6ac9efbd-5a1b-4cf7-b42c-d28aeca08829 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:34.838527 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-6ac9efbd-5a1b-4cf7-b42c-d28aeca08829 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:34.844998 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6ac9efbd-5a1b-4cf7-b42c-d28aeca08829 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:34.845493 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6ac9efbd-5a1b-4cf7-b42c-d28aeca08829 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:34.845926 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6ac9efbd-5a1b-4cf7-b42c-d28aeca08829 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:34.846605 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6ac9efbd-5a1b-4cf7-b42c-d28aeca08829 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:34.847079 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6ac9efbd-5a1b-4cf7-b42c-d28aeca08829 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:34.847497 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6ac9efbd-5a1b-4cf7-b42c-d28aeca08829 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:34.860408 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-9a160546-7a4a-4ef5-abcc-a19798da299c tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:34.864482 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:21:34.870280 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-9a160546-7a4a-4ef5-abcc-a19798da299c tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828" status: 200 len: 1332 microversion: 2.1 time: 0.103993 Aug 09 11:21:34.870886 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 265/558] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:34 2022] GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828 => generated 1332 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:34.982652 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-6ac9efbd-5a1b-4cf7-b42c-d28aeca08829 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:34.990132 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-6ac9efbd-5a1b-4cf7-b42c-d28aeca08829 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1677 microversion: 2.1 time: 0.156468 Aug 09 11:21:34.990695 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 294/559] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:34 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:35.178405 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [req-7db82f51-971f-4efa-8bd5-b3ab1859a485 req-d4dcfe01-f0b1-44a6-9b22-d12f9d2215bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69542c8c-90b6-49a4-aed3-c229168f215f", "name": "network-vif-plugged", "status": "completed", "tag": "e9e1072a-3971-440e-9a60-ba15e5db60f3"}]} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:21:35.192537 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-7db82f51-971f-4efa-8bd5-b3ab1859a485 req-d4dcfe01-f0b1-44a6-9b22-d12f9d2215bd service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:35.192537 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-7db82f51-971f-4efa-8bd5-b3ab1859a485 req-d4dcfe01-f0b1-44a6-9b22-d12f9d2215bd service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:35.192537 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-7db82f51-971f-4efa-8bd5-b3ab1859a485 req-d4dcfe01-f0b1-44a6-9b22-d12f9d2215bd service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:35.205634 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.compute.server_external_events [req-7db82f51-971f-4efa-8bd5-b3ab1859a485 req-d4dcfe01-f0b1-44a6-9b22-d12f9d2215bd service nova] Creating event network-vif-plugged:e9e1072a-3971-440e-9a60-ba15e5db60f3 for instance 69542c8c-90b6-49a4-aed3-c229168f215f on hv-cinder-85251 Aug 09 11:21:35.211141 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [req-7db82f51-971f-4efa-8bd5-b3ab1859a485 req-d4dcfe01-f0b1-44a6-9b22-d12f9d2215bd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036190 Aug 09 11:21:35.212503 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 266/560] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:21:35.403628 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-a4761626-b03d-4437-99c1-d045403decc7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:35.404229 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-a4761626-b03d-4437-99c1-d045403decc7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:35.412168 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a4761626-b03d-4437-99c1-d045403decc7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:35.412778 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a4761626-b03d-4437-99c1-d045403decc7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:35.413278 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a4761626-b03d-4437-99c1-d045403decc7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:35.414122 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a4761626-b03d-4437-99c1-d045403decc7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:35.414641 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a4761626-b03d-4437-99c1-d045403decc7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:35.415139 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a4761626-b03d-4437-99c1-d045403decc7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:35.564616 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-a4761626-b03d-4437-99c1-d045403decc7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:35.572561 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-a4761626-b03d-4437-99c1-d045403decc7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1510 microversion: 2.1 time: 0.173771 Aug 09 11:21:35.573128 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 295/561] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:35 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1510 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:35.735874 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-322d9334-5477-4f2a-8f5f-67f71964b589 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:35.736684 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-322d9334-5477-4f2a-8f5f-67f71964b589 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] [instance: 14c1cdbe-3b15-499a-88b5-7f86dfc5501b] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:35.742748 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-cf59117f-624c-4f0c-82f8-e810969b8c4d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:35.743420 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-cf59117f-624c-4f0c-82f8-e810969b8c4d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:35.743760 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-322d9334-5477-4f2a-8f5f-67f71964b589 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:35.744243 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-322d9334-5477-4f2a-8f5f-67f71964b589 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:35.744712 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-322d9334-5477-4f2a-8f5f-67f71964b589 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:35.745408 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-322d9334-5477-4f2a-8f5f-67f71964b589 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:35.745853 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-322d9334-5477-4f2a-8f5f-67f71964b589 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:35.746311 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-322d9334-5477-4f2a-8f5f-67f71964b589 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:35.749526 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-cf59117f-624c-4f0c-82f8-e810969b8c4d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:35.750002 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-cf59117f-624c-4f0c-82f8-e810969b8c4d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:35.750479 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-cf59117f-624c-4f0c-82f8-e810969b8c4d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:35.752231 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-cf59117f-624c-4f0c-82f8-e810969b8c4d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:35.752231 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-cf59117f-624c-4f0c-82f8-e810969b8c4d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:35.752231 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-cf59117f-624c-4f0c-82f8-e810969b8c4d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:35.942767 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-322d9334-5477-4f2a-8f5f-67f71964b589 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff3135cc1482461caf69068b659f49e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2f6acb3c3a4b24be797a677d868227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:35.948179 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-cf59117f-624c-4f0c-82f8-e810969b8c4d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:35.950755 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-322d9334-5477-4f2a-8f5f-67f71964b589 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] 10.222.0.27 "GET /compute/v2.1/servers/14c1cdbe-3b15-499a-88b5-7f86dfc5501b" status: 200 len: 1513 microversion: 2.1 time: 0.219229 Aug 09 11:21:35.951370 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 267/562] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:35 2022] GET /compute/v2.1/servers/14c1cdbe-3b15-499a-88b5-7f86dfc5501b => generated 1513 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:35.957186 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-cf59117f-624c-4f0c-82f8-e810969b8c4d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:35.958631 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-24fcd099-011c-4b7b-bb62-b90311876861 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:35.958789 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-cf59117f-624c-4f0c-82f8-e810969b8c4d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:35.959397 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-24fcd099-011c-4b7b-bb62-b90311876861 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: eee55879-1bf3-41e4-b439-0c903100e828] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:35.959767 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-cf59117f-624c-4f0c-82f8-e810969b8c4d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.220909 Aug 09 11:21:35.960577 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 296/563] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:21:35 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:21:35.965674 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-24fcd099-011c-4b7b-bb62-b90311876861 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:35.966171 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-24fcd099-011c-4b7b-bb62-b90311876861 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:35.966588 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-24fcd099-011c-4b7b-bb62-b90311876861 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:35.967284 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-24fcd099-011c-4b7b-bb62-b90311876861 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:35.967727 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-24fcd099-011c-4b7b-bb62-b90311876861 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:35.968150 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-24fcd099-011c-4b7b-bb62-b90311876861 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:36.001518 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-24fcd099-011c-4b7b-bb62-b90311876861 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:36.001955 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-24fcd099-011c-4b7b-bb62-b90311876861 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:36.002378 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-24fcd099-011c-4b7b-bb62-b90311876861 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:36.002815 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.objects.instance [None req-24fcd099-011c-4b7b-bb62-b90311876861 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lazy-loading 'fault' on Instance uuid eee55879-1bf3-41e4-b439-0c903100e828 {{(pid=117684) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:21:36.011206 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-eb0fbaa1-9711-4c98-93c1-a4245fe344fb tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:36.011942 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-eb0fbaa1-9711-4c98-93c1-a4245fe344fb tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:36.018274 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-eb0fbaa1-9711-4c98-93c1-a4245fe344fb tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:36.018760 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-eb0fbaa1-9711-4c98-93c1-a4245fe344fb tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:36.019192 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-eb0fbaa1-9711-4c98-93c1-a4245fe344fb tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:36.019886 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-eb0fbaa1-9711-4c98-93c1-a4245fe344fb tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:36.020365 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-eb0fbaa1-9711-4c98-93c1-a4245fe344fb tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:36.020790 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-eb0fbaa1-9711-4c98-93c1-a4245fe344fb tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:36.045091 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-24fcd099-011c-4b7b-bb62-b90311876861 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:36.052470 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-24fcd099-011c-4b7b-bb62-b90311876861 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828" status: 200 len: 1332 microversion: 2.1 time: 0.097448 Aug 09 11:21:36.053029 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 268/564] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:35 2022] GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828 => generated 1332 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:36.162091 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-eb0fbaa1-9711-4c98-93c1-a4245fe344fb tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:36.169584 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-eb0fbaa1-9711-4c98-93c1-a4245fe344fb tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1677 microversion: 2.1 time: 0.162383 Aug 09 11:21:36.170154 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 297/565] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:36 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:21:36.597982 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-d326ca0a-ec6a-477a-afa5-334e0c8ec70e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:36.598966 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-d326ca0a-ec6a-477a-afa5-334e0c8ec70e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:36.606474 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d326ca0a-ec6a-477a-afa5-334e0c8ec70e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:36.606950 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d326ca0a-ec6a-477a-afa5-334e0c8ec70e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:36.607371 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d326ca0a-ec6a-477a-afa5-334e0c8ec70e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:36.608056 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d326ca0a-ec6a-477a-afa5-334e0c8ec70e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:36.608542 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d326ca0a-ec6a-477a-afa5-334e0c8ec70e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:36.608950 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d326ca0a-ec6a-477a-afa5-334e0c8ec70e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:36.757205 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-d326ca0a-ec6a-477a-afa5-334e0c8ec70e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:36.765966 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-d326ca0a-ec6a-477a-afa5-334e0c8ec70e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1516 microversion: 2.1 time: 0.174376 Aug 09 11:21:36.766554 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 269/566] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:36 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1516 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:36.972792 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-fd12a025-0cd4-40a7-84a5-335ec489b8c2 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:36.973501 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-fd12a025-0cd4-40a7-84a5-335ec489b8c2 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] [instance: 14c1cdbe-3b15-499a-88b5-7f86dfc5501b] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:36.975650 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:21:36.981285 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fd12a025-0cd4-40a7-84a5-335ec489b8c2 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:36.981971 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fd12a025-0cd4-40a7-84a5-335ec489b8c2 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:36.982526 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fd12a025-0cd4-40a7-84a5-335ec489b8c2 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:36.982982 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-d5c06d08-136f-4c77-9dfc-8a3f5602eb3f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:36.983207 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fd12a025-0cd4-40a7-84a5-335ec489b8c2 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:36.983592 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-d5c06d08-136f-4c77-9dfc-8a3f5602eb3f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:36.983813 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fd12a025-0cd4-40a7-84a5-335ec489b8c2 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:36.984566 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fd12a025-0cd4-40a7-84a5-335ec489b8c2 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:36.990377 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d5c06d08-136f-4c77-9dfc-8a3f5602eb3f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:36.990981 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d5c06d08-136f-4c77-9dfc-8a3f5602eb3f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:36.991417 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d5c06d08-136f-4c77-9dfc-8a3f5602eb3f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:36.992608 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d5c06d08-136f-4c77-9dfc-8a3f5602eb3f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:36.993357 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d5c06d08-136f-4c77-9dfc-8a3f5602eb3f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:36.994447 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d5c06d08-136f-4c77-9dfc-8a3f5602eb3f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:37.203733 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-fd12a025-0cd4-40a7-84a5-335ec489b8c2 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff3135cc1482461caf69068b659f49e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2f6acb3c3a4b24be797a677d868227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:37.212629 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-fd12a025-0cd4-40a7-84a5-335ec489b8c2 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] 10.222.0.27 "GET /compute/v2.1/servers/14c1cdbe-3b15-499a-88b5-7f86dfc5501b" status: 200 len: 1513 microversion: 2.1 time: 0.244036 Aug 09 11:21:37.213226 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 298/567] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:36 2022] GET /compute/v2.1/servers/14c1cdbe-3b15-499a-88b5-7f86dfc5501b => generated 1513 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:37.229279 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-f10f89f4-a794-4471-b22a-fb6f1a63a748 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:37.230395 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-f10f89f4-a794-4471-b22a-fb6f1a63a748 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: eee55879-1bf3-41e4-b439-0c903100e828] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:37.239973 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f10f89f4-a794-4471-b22a-fb6f1a63a748 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:37.241063 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f10f89f4-a794-4471-b22a-fb6f1a63a748 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:37.241534 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f10f89f4-a794-4471-b22a-fb6f1a63a748 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:37.243224 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f10f89f4-a794-4471-b22a-fb6f1a63a748 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:37.243347 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-d5c06d08-136f-4c77-9dfc-8a3f5602eb3f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:37.244518 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f10f89f4-a794-4471-b22a-fb6f1a63a748 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:37.245156 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f10f89f4-a794-4471-b22a-fb6f1a63a748 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:37.260345 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-d5c06d08-136f-4c77-9dfc-8a3f5602eb3f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:37.262667 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-d5c06d08-136f-4c77-9dfc-8a3f5602eb3f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:37.264056 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-d5c06d08-136f-4c77-9dfc-8a3f5602eb3f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.285726 Aug 09 11:21:37.273023 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 270/568] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:21:36 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:21:37.284413 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-2ef686da-5a46-4c9b-a817-84b0ce72253e tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:37.285166 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-2ef686da-5a46-4c9b-a817-84b0ce72253e tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:37.293042 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2ef686da-5a46-4c9b-a817-84b0ce72253e tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:37.294722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f10f89f4-a794-4471-b22a-fb6f1a63a748 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:37.295376 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f10f89f4-a794-4471-b22a-fb6f1a63a748 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:37.295962 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f10f89f4-a794-4471-b22a-fb6f1a63a748 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:37.296648 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2ef686da-5a46-4c9b-a817-84b0ce72253e tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:37.296799 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.objects.instance [None req-f10f89f4-a794-4471-b22a-fb6f1a63a748 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lazy-loading 'fault' on Instance uuid eee55879-1bf3-41e4-b439-0c903100e828 {{(pid=117685) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:21:37.297094 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2ef686da-5a46-4c9b-a817-84b0ce72253e tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:37.297809 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2ef686da-5a46-4c9b-a817-84b0ce72253e tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:37.298251 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2ef686da-5a46-4c9b-a817-84b0ce72253e tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:37.298990 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2ef686da-5a46-4c9b-a817-84b0ce72253e tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:37.384205 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-f10f89f4-a794-4471-b22a-fb6f1a63a748 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:37.391703 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-f10f89f4-a794-4471-b22a-fb6f1a63a748 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828" status: 200 len: 1332 microversion: 2.1 time: 0.177183 Aug 09 11:21:37.393031 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 299/569] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:37 2022] GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828 => generated 1332 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:37.490748 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-2ef686da-5a46-4c9b-a817-84b0ce72253e tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:37.498840 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-2ef686da-5a46-4c9b-a817-84b0ce72253e tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1677 microversion: 2.1 time: 0.224241 Aug 09 11:21:37.499447 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 271/570] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:37 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1677 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:37.693773 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-4fa1b9dd-a81e-4a06-ac10-b32e2f39ddd6 req-4b9a2196-126d-438b-a669-f5dd8e3bf6f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14c1cdbe-3b15-499a-88b5-7f86dfc5501b", "name": "network-vif-deleted", "tag": "c1c36676-90bc-4859-a8f2-d09c6b02519b"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:21:37.713822 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-4fa1b9dd-a81e-4a06-ac10-b32e2f39ddd6 req-4b9a2196-126d-438b-a669-f5dd8e3bf6f9 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:37.714297 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-4fa1b9dd-a81e-4a06-ac10-b32e2f39ddd6 req-4b9a2196-126d-438b-a669-f5dd8e3bf6f9 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:37.714850 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-4fa1b9dd-a81e-4a06-ac10-b32e2f39ddd6 req-4b9a2196-126d-438b-a669-f5dd8e3bf6f9 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:37.727058 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-4fa1b9dd-a81e-4a06-ac10-b32e2f39ddd6 req-4b9a2196-126d-438b-a669-f5dd8e3bf6f9 service nova] Creating event network-vif-deleted:c1c36676-90bc-4859-a8f2-d09c6b02519b for instance 14c1cdbe-3b15-499a-88b5-7f86dfc5501b on hv-cinder-85251 Aug 09 11:21:37.732393 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-4fa1b9dd-a81e-4a06-ac10-b32e2f39ddd6 req-4b9a2196-126d-438b-a669-f5dd8e3bf6f9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044799 Aug 09 11:21:37.732996 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 300/571] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:21:38.159360 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-9d5b8c89-a5a8-4503-bc30-f0ff2867788e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Action: 'create', calling method: .version_select at 0x7f2821f4c5e0>, body: {"keypair": {"name": "tempest-keypair-1799456783", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEUQS1Ia4FVeceE8jIHXDSuPga2Y1nUtGIBaWKMS+XCt5CbtABQgCkvhGGMuMRTKyIZf285kJ/SspAYWEXG3DCf+KZ4e1vy1tUhTaQ5xLeN21j/IzMy/0p1FxNQGnWZvQ=="}} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:21:38.176992 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.quota [None req-9d5b8c89-a5a8-4503-bc30-f0ff2867788e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Getting quotas for project 45bb3a603ddc4d3b8042b6ae687c896e. Resources: {'key_pairs'} {{(pid=117684) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:21:38.181157 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.quota [None req-9d5b8c89-a5a8-4503-bc30-f0ff2867788e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Getting quotas for user 3a1cd35a257f4b0f99141580c14bad48 and project 45bb3a603ddc4d3b8042b6ae687c896e. Resources: {'key_pairs'} {{(pid=117684) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:21:38.207254 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-9d5b8c89-a5a8-4503-bc30-f0ff2867788e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051889 Aug 09 11:21:38.207845 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 272/572] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 9 11:21:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:21:38.235155 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-ef8ff532-c8b8-4f82-846e-57d5021d4874 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:38.235933 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-ef8ff532-c8b8-4f82-846e-57d5021d4874 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] [instance: 14c1cdbe-3b15-499a-88b5-7f86dfc5501b] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:38.242480 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ef8ff532-c8b8-4f82-846e-57d5021d4874 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:38.243022 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ef8ff532-c8b8-4f82-846e-57d5021d4874 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:38.243626 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ef8ff532-c8b8-4f82-846e-57d5021d4874 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:38.244433 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ef8ff532-c8b8-4f82-846e-57d5021d4874 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:38.244949 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ef8ff532-c8b8-4f82-846e-57d5021d4874 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:38.245430 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ef8ff532-c8b8-4f82-846e-57d5021d4874 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:38.277940 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ef8ff532-c8b8-4f82-846e-57d5021d4874 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:38.279055 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ef8ff532-c8b8-4f82-846e-57d5021d4874 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:38.279488 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ef8ff532-c8b8-4f82-846e-57d5021d4874 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:38.279933 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.objects.instance [None req-ef8ff532-c8b8-4f82-846e-57d5021d4874 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lazy-loading 'fault' on Instance uuid 14c1cdbe-3b15-499a-88b5-7f86dfc5501b {{(pid=117685) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:21:38.287589 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-fd770aa9-578c-43ae-9ce3-e6d3eee4156d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:38.288216 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-fd770aa9-578c-43ae-9ce3-e6d3eee4156d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:38.295654 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-fd770aa9-578c-43ae-9ce3-e6d3eee4156d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:38.296145 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-fd770aa9-578c-43ae-9ce3-e6d3eee4156d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:38.296612 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-fd770aa9-578c-43ae-9ce3-e6d3eee4156d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:38.297315 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-fd770aa9-578c-43ae-9ce3-e6d3eee4156d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:38.297759 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-fd770aa9-578c-43ae-9ce3-e6d3eee4156d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:38.298375 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-fd770aa9-578c-43ae-9ce3-e6d3eee4156d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:38.354065 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-ef8ff532-c8b8-4f82-846e-57d5021d4874 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff3135cc1482461caf69068b659f49e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2f6acb3c3a4b24be797a677d868227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:38.361739 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-ef8ff532-c8b8-4f82-846e-57d5021d4874 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] 10.222.0.27 "GET /compute/v2.1/servers/14c1cdbe-3b15-499a-88b5-7f86dfc5501b" status: 200 len: 1308 microversion: 2.1 time: 0.131378 Aug 09 11:21:38.362304 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 301/573] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:38 2022] GET /compute/v2.1/servers/14c1cdbe-3b15-499a-88b5-7f86dfc5501b => generated 1308 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:38.413318 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-b2baeb5f-bed3-4094-9834-2aca4ca13a6e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:38.413915 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-b2baeb5f-bed3-4094-9834-2aca4ca13a6e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: eee55879-1bf3-41e4-b439-0c903100e828] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:38.420043 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b2baeb5f-bed3-4094-9834-2aca4ca13a6e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:38.420547 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b2baeb5f-bed3-4094-9834-2aca4ca13a6e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:38.420971 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b2baeb5f-bed3-4094-9834-2aca4ca13a6e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:38.421648 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b2baeb5f-bed3-4094-9834-2aca4ca13a6e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:38.422255 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b2baeb5f-bed3-4094-9834-2aca4ca13a6e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:38.422666 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b2baeb5f-bed3-4094-9834-2aca4ca13a6e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:38.437859 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.wsgi [None req-b2baeb5f-bed3-4094-9834-2aca4ca13a6e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] HTTP exception thrown: Instance eee55879-1bf3-41e4-b439-0c903100e828 could not be found. Aug 09 11:21:38.440017 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-b2baeb5f-bed3-4094-9834-2aca4ca13a6e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Request method failure captured: Aug 09 11:21:38.440017 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: request: GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828 HTTP/1.1 Aug 09 11:21:38.440017 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Accept: application/json Aug 09 11:21:38.440017 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Accept-Encoding: identity Aug 09 11:21:38.440017 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Connection: close Aug 09 11:21:38.440017 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Content-Length: 0 Aug 09 11:21:38.440017 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Content-Type: application/json Aug 09 11:21:38.440017 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Host: 10.222.0.27 Aug 09 11:21:38.440017 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Openstack-System-Scope: None Aug 09 11:21:38.440017 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: User-Agent: python-urllib3/1.26.11 Aug 09 11:21:38.440017 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Auth-Token: gAAAAABi8kJrkCuZ0ZtlZIUmAC-EK2I0okp8exzRXbUBoHrpFGaG17TfS3kn4sSvkBzyMOMoCBQBmvOs9UrhF5xw2U46aP5Pxlq5Kj8piUuPsDzn7s8ETM_3P18gyColYBDIhcjSMUGohuoeVN3S8QIKYIofZURyiH1QY4Vi6NWdxWuymPkih0k Aug 09 11:21:38.440017 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Domain-Id: None Aug 09 11:21:38.440017 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Domain-Name: None Aug 09 11:21:38.440017 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Identity-Status: Confirmed Aug 09 11:21:38.440017 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Is-Admin-Project: True Aug 09 11:21:38.440017 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Domain-Id: default Aug 09 11:21:38.440017 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Domain-Name: Default Aug 09 11:21:38.440017 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Id: cba1dd0b689b4fff847b6fd3787b143c Aug 09 11:21:38.440017 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Name: tempest-AttachVolumeNegativeTest-1410930012 Aug 09 11:21:38.440017 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Role: member,reader Aug 09 11:21:38.440017 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Roles: member,reader Aug 09 11:21:38.441511 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:21:38.441511 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant: tempest-AttachVolumeNegativeTest-1410930012 Aug 09 11:21:38.441511 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant-Id: cba1dd0b689b4fff847b6fd3787b143c Aug 09 11:21:38.441511 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1410930012 Aug 09 11:21:38.441511 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User: tempest-AttachVolumeNegativeTest-1410930012-project Aug 09 11:21:38.441511 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Domain-Id: default Aug 09 11:21:38.441511 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Domain-Name: Default Aug 09 11:21:38.441511 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Id: f4da6dd860bb45d1a703a18c2512ffe4 Aug 09 11:21:38.441511 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Name: tempest-AttachVolumeNegativeTest-1410930012-project Aug 09 11:21:38.441511 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: method: > Aug 09 11:21:38.441511 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: exception: Instance eee55879-1bf3-41e4-b439-0c903100e828 could not be found. Aug 09 11:21:38.441511 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: action_args: {'id': 'eee55879-1bf3-41e4-b439-0c903100e828'} Aug 09 11:21:38.442263 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:21:38.442263 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:21:38.442263 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:21:38.442263 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:21:38.442263 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:21:38.442263 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:21:38.442263 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:21:38.442263 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:21:38.442263 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:21:38.442263 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:21:38.442263 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eee55879-1bf3-41e4-b439-0c903100e828 could not be found. Aug 09 11:21:38.442263 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:21:38.442263 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:21:38.442263 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:21:38.442263 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:21:38.442263 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:21:38.442263 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:21:38.442263 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:21:38.442263 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:21:38.442263 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:21:38.443515 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:21:38.443515 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:21:38.443515 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:21:38.443515 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:21:38.443515 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:21:38.443515 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:21:38.443515 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:21:38.443515 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eee55879-1bf3-41e4-b439-0c903100e828 could not be found. Aug 09 11:21:38.443515 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:21:38.443515 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:21:38.443515 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:21:38.443515 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:21:38.443515 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:21:38.443515 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:21:38.443515 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:21:38.443515 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:21:38.443515 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eee55879-1bf3-41e4-b439-0c903100e828 could not be found. Aug 09 11:21:38.443515 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:21:38.446390 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-b2baeb5f-bed3-4094-9834-2aca4ca13a6e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Returning 404 to user: Instance eee55879-1bf3-41e4-b439-0c903100e828 could not be found. {{(pid=117685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:21:38.446390 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-b2baeb5f-bed3-4094-9834-2aca4ca13a6e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828" status: 404 len: 111 microversion: 2.1 time: 0.032437 Aug 09 11:21:38.446390 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 302/574] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:38 2022] GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:21:38.450972 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-91a773a9-7558-4de5-8211-10fee6cdfa42 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '.version_select at 0x7f2821ef8af0>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:38.493781 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-91a773a9-7558-4de5-8211-10fee6cdfa42 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1200039219" status: 202 len: 0 microversion: 2.1 time: 0.046604 Aug 09 11:21:38.494419 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 303/575] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Aug 9 11:21:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1200039219 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:21:38.495275 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-fd770aa9-578c-43ae-9ce3-e6d3eee4156d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:38.506960 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-fd770aa9-578c-43ae-9ce3-e6d3eee4156d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:38.509652 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-fd770aa9-578c-43ae-9ce3-e6d3eee4156d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:38.510872 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-fd770aa9-578c-43ae-9ce3-e6d3eee4156d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.227752 Aug 09 11:21:38.528538 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 273/576] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:21:38 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 11:21:38.533214 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-e330c0f6-ccfc-4265-8188-019820623979 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:38.533894 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-e330c0f6-ccfc-4265-8188-019820623979 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:38.551848 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e330c0f6-ccfc-4265-8188-019820623979 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:38.559447 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e330c0f6-ccfc-4265-8188-019820623979 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:38.560081 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e330c0f6-ccfc-4265-8188-019820623979 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:38.565287 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e330c0f6-ccfc-4265-8188-019820623979 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:38.565778 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e330c0f6-ccfc-4265-8188-019820623979 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:38.566412 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e330c0f6-ccfc-4265-8188-019820623979 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:39.020808 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-e330c0f6-ccfc-4265-8188-019820623979 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:39.028177 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-e330c0f6-ccfc-4265-8188-019820623979 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1677 microversion: 2.1 time: 0.498355 Aug 09 11:21:39.042374 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 304/577] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:38 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1677 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:21:39.383177 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-95540816-f34b-4b11-853d-fb00bf70a613 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:39.384076 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-95540816-f34b-4b11-853d-fb00bf70a613 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] [instance: 14c1cdbe-3b15-499a-88b5-7f86dfc5501b] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:39.398716 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-95540816-f34b-4b11-853d-fb00bf70a613 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:39.399206 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-95540816-f34b-4b11-853d-fb00bf70a613 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:39.399641 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-95540816-f34b-4b11-853d-fb00bf70a613 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:39.400353 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-95540816-f34b-4b11-853d-fb00bf70a613 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:39.401031 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-95540816-f34b-4b11-853d-fb00bf70a613 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:39.401445 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-95540816-f34b-4b11-853d-fb00bf70a613 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:39.416791 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.wsgi [None req-95540816-f34b-4b11-853d-fb00bf70a613 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] HTTP exception thrown: Instance 14c1cdbe-3b15-499a-88b5-7f86dfc5501b could not be found. Aug 09 11:21:39.419043 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-95540816-f34b-4b11-853d-fb00bf70a613 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Request method failure captured: Aug 09 11:21:39.419043 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: request: GET /compute/v2.1/servers/14c1cdbe-3b15-499a-88b5-7f86dfc5501b HTTP/1.1 Aug 09 11:21:39.419043 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept: application/json Aug 09 11:21:39.419043 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept-Encoding: identity Aug 09 11:21:39.419043 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Connection: close Aug 09 11:21:39.419043 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Length: 0 Aug 09 11:21:39.419043 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Type: application/json Aug 09 11:21:39.419043 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Host: 10.222.0.27 Aug 09 11:21:39.419043 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Openstack-System-Scope: None Aug 09 11:21:39.419043 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: User-Agent: python-urllib3/1.26.11 Aug 09 11:21:39.419043 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Auth-Token: gAAAAABi8kLDGaGqFyHi2tgdJCz0eNCvayv_xUhZWeHkcnFKPYVj2qXfab9rkwpXrmvHm5_m0mIc-9i4T44mlleBVc0-bYdbjzmNoHJiPWiuBH0BNP5IOLosAp-m2LuL2MKWKCQBLFG7jh57bVL5npEA-wp7ZJ0JlrwXIHRJ4oPPv5l6P__KnF4 Aug 09 11:21:39.419043 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Id: None Aug 09 11:21:39.419043 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Name: None Aug 09 11:21:39.419043 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Identity-Status: Confirmed Aug 09 11:21:39.419043 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Is-Admin-Project: True Aug 09 11:21:39.419043 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Id: default Aug 09 11:21:39.419043 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Name: Default Aug 09 11:21:39.419043 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Id: 7a2f6acb3c3a4b24be797a677d868227 Aug 09 11:21:39.419043 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Name: tempest-VolumesSnapshotTestJSON-318962451 Aug 09 11:21:39.419043 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Role: member,reader Aug 09 11:21:39.419043 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Roles: member,reader Aug 09 11:21:39.420475 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a2f6acb3c3a4b24be797a677d868227"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7a2f6acb3c3a4b24be797a677d868227"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7a2f6acb3c3a4b24be797a677d868227"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a2f6acb3c3a4b24be797a677d868227"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:21:39.420475 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant: tempest-VolumesSnapshotTestJSON-318962451 Aug 09 11:21:39.420475 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Id: 7a2f6acb3c3a4b24be797a677d868227 Aug 09 11:21:39.420475 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-318962451 Aug 09 11:21:39.420475 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User: tempest-VolumesSnapshotTestJSON-318962451-project Aug 09 11:21:39.420475 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Id: default Aug 09 11:21:39.420475 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Name: Default Aug 09 11:21:39.420475 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Id: ff3135cc1482461caf69068b659f49e4 Aug 09 11:21:39.420475 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Name: tempest-VolumesSnapshotTestJSON-318962451-project Aug 09 11:21:39.420475 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: method: > Aug 09 11:21:39.420475 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: exception: Instance 14c1cdbe-3b15-499a-88b5-7f86dfc5501b could not be found. Aug 09 11:21:39.420475 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: action_args: {'id': '14c1cdbe-3b15-499a-88b5-7f86dfc5501b'} Aug 09 11:21:39.421365 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:21:39.421365 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:21:39.421365 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:21:39.421365 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:21:39.421365 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:21:39.421365 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:21:39.421365 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:21:39.421365 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:21:39.421365 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:21:39.421365 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:21:39.421365 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14c1cdbe-3b15-499a-88b5-7f86dfc5501b could not be found. Aug 09 11:21:39.421365 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:21:39.421365 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:21:39.421365 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:21:39.421365 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:21:39.421365 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:21:39.421365 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:21:39.421365 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:21:39.421365 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:21:39.421365 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:21:39.422720 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:21:39.422720 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:21:39.422720 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:21:39.422720 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:21:39.422720 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:21:39.422720 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:21:39.422720 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:21:39.422720 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14c1cdbe-3b15-499a-88b5-7f86dfc5501b could not be found. Aug 09 11:21:39.422720 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:21:39.422720 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:21:39.422720 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:21:39.422720 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:21:39.422720 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:21:39.422720 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:21:39.422720 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:21:39.422720 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:21:39.422720 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14c1cdbe-3b15-499a-88b5-7f86dfc5501b could not be found. Aug 09 11:21:39.422720 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:21:39.424784 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-95540816-f34b-4b11-853d-fb00bf70a613 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Returning 404 to user: Instance 14c1cdbe-3b15-499a-88b5-7f86dfc5501b could not be found. {{(pid=117684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:21:39.424784 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-95540816-f34b-4b11-853d-fb00bf70a613 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] 10.222.0.27 "GET /compute/v2.1/servers/14c1cdbe-3b15-499a-88b5-7f86dfc5501b" status: 404 len: 111 microversion: 2.1 time: 0.041623 Aug 09 11:21:39.425342 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 274/578] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:39 2022] GET /compute/v2.1/servers/14c1cdbe-3b15-499a-88b5-7f86dfc5501b => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:21:39.538245 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-e5467243-2593-4eb9-bd7d-c2fd4290e5de tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:39.538972 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-e5467243-2593-4eb9-bd7d-c2fd4290e5de tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:39.547717 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e5467243-2593-4eb9-bd7d-c2fd4290e5de tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:39.548773 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e5467243-2593-4eb9-bd7d-c2fd4290e5de tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:39.549277 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e5467243-2593-4eb9-bd7d-c2fd4290e5de tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:39.550188 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e5467243-2593-4eb9-bd7d-c2fd4290e5de tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:39.550939 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e5467243-2593-4eb9-bd7d-c2fd4290e5de tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:39.551643 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e5467243-2593-4eb9-bd7d-c2fd4290e5de tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:39.754627 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-e5467243-2593-4eb9-bd7d-c2fd4290e5de tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:39.764898 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-e5467243-2593-4eb9-bd7d-c2fd4290e5de tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:39.766591 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-e5467243-2593-4eb9-bd7d-c2fd4290e5de tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:39.768095 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-e5467243-2593-4eb9-bd7d-c2fd4290e5de tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.235467 Aug 09 11:21:39.768678 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 305/579] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:21:39 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:21:40.049943 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-31f373d5-ee5f-48fb-a8d5-7dcbc9d58b84 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:40.050969 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-31f373d5-ee5f-48fb-a8d5-7dcbc9d58b84 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:40.057725 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-31f373d5-ee5f-48fb-a8d5-7dcbc9d58b84 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:40.058470 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-31f373d5-ee5f-48fb-a8d5-7dcbc9d58b84 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:40.058905 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-31f373d5-ee5f-48fb-a8d5-7dcbc9d58b84 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:40.059613 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-31f373d5-ee5f-48fb-a8d5-7dcbc9d58b84 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:40.060065 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-31f373d5-ee5f-48fb-a8d5-7dcbc9d58b84 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:40.060716 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-31f373d5-ee5f-48fb-a8d5-7dcbc9d58b84 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:40.169020 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-6e9a62d0-a8f4-4493-98a9-f262bb04240f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:40.169558 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-6e9a62d0-a8f4-4493-98a9-f262bb04240f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 1329e8e9-9358-454d-bea3-dad19dfc53da] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:40.175940 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6e9a62d0-a8f4-4493-98a9-f262bb04240f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:40.181758 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6e9a62d0-a8f4-4493-98a9-f262bb04240f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:40.182237 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6e9a62d0-a8f4-4493-98a9-f262bb04240f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:40.182954 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6e9a62d0-a8f4-4493-98a9-f262bb04240f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:40.183403 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6e9a62d0-a8f4-4493-98a9-f262bb04240f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:40.183817 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6e9a62d0-a8f4-4493-98a9-f262bb04240f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:40.228786 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-31f373d5-ee5f-48fb-a8d5-7dcbc9d58b84 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:40.237593 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-31f373d5-ee5f-48fb-a8d5-7dcbc9d58b84 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1677 microversion: 2.1 time: 0.191652 Aug 09 11:21:40.238449 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 275/580] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:40 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1677 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:40.274238 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.objects.instance [None req-6e9a62d0-a8f4-4493-98a9-f262bb04240f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lazy-loading 'services' on Instance uuid 1329e8e9-9358-454d-bea3-dad19dfc53da {{(pid=117685) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:21:40.352725 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-6e9a62d0-a8f4-4493-98a9-f262bb04240f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da/os-volume_attachments/397e1f98-323e-4201-be0c-de0567926b8a" status: 202 len: 0 microversion: 2.1 time: 0.187819 Aug 09 11:21:40.353458 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 306/581] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Aug 9 11:21:40 2022] DELETE /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da/os-volume_attachments/397e1f98-323e-4201-be0c-de0567926b8a => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 11:21:40.362316 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-b1aee2ff-e64e-43e2-bdf9-d3a843bf0b59 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:40.364650 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-b1aee2ff-e64e-43e2-bdf9-d3a843bf0b59 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 1329e8e9-9358-454d-bea3-dad19dfc53da] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:40.370850 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b1aee2ff-e64e-43e2-bdf9-d3a843bf0b59 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:40.371323 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b1aee2ff-e64e-43e2-bdf9-d3a843bf0b59 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:40.371585 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-91eabca7-4e91-4914-9f1f-a04511f7a9da tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-85709923", "imageRef": "2321e9a0-fe0f-47fd-9c4b-8868eb5a00af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "12e0a510-22d0-41f2-a60e-16ee2de67eb5"}], "security_groups": [{"name": "tempest-securitygroup--847001383"}], "key_name": "tempest-keypair-1799456783", "user_data": "}} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:21:40.371731 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b1aee2ff-e64e-43e2-bdf9-d3a843bf0b59 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:40.372458 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b1aee2ff-e64e-43e2-bdf9-d3a843bf0b59 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:40.372909 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b1aee2ff-e64e-43e2-bdf9-d3a843bf0b59 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:40.373319 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b1aee2ff-e64e-43e2-bdf9-d3a843bf0b59 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:40.404864 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-b1aee2ff-e64e-43e2-bdf9-d3a843bf0b59 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046611 Aug 09 11:21:40.405642 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 276/582] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 9 11:21:40 2022] GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:21:40.480037 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.network.neutron [None req-91eabca7-4e91-4914-9f1f-a04511f7a9da tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] validate_networks() for [('12e0a510-22d0-41f2-a60e-16ee2de67eb5', None, None, None, None, None)] {{(pid=117685) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 11:21:40.791119 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-a439215d-a237-494a-bb6b-c01164acbcdd tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:40.791725 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-a439215d-a237-494a-bb6b-c01164acbcdd tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:40.798048 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a439215d-a237-494a-bb6b-c01164acbcdd tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:40.798533 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a439215d-a237-494a-bb6b-c01164acbcdd tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:40.798964 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a439215d-a237-494a-bb6b-c01164acbcdd tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:40.799661 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a439215d-a237-494a-bb6b-c01164acbcdd tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:40.800110 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a439215d-a237-494a-bb6b-c01164acbcdd tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:40.800566 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a439215d-a237-494a-bb6b-c01164acbcdd tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:40.886954 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-91eabca7-4e91-4914-9f1f-a04511f7a9da tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Flavor limits 0:0:0 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 11:21:40.887457 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-91eabca7-4e91-4914-9f1f-a04511f7a9da tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Image limits 0:0:0 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 11:21:40.887827 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-91eabca7-4e91-4914-9f1f-a04511f7a9da tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Flavor pref 0:0:0 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 11:21:40.888231 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-91eabca7-4e91-4914-9f1f-a04511f7a9da tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Image pref 0:0:0 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 11:21:40.888665 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-91eabca7-4e91-4914-9f1f-a04511f7a9da tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 11:21:40.898455 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-91eabca7-4e91-4914-9f1f-a04511f7a9da tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:40.899014 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-91eabca7-4e91-4914-9f1f-a04511f7a9da tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:40.899443 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-91eabca7-4e91-4914-9f1f-a04511f7a9da tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:40.900232 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-91eabca7-4e91-4914-9f1f-a04511f7a9da tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:40.900732 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-91eabca7-4e91-4914-9f1f-a04511f7a9da tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:40.901149 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-91eabca7-4e91-4914-9f1f-a04511f7a9da tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:40.923400 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.quota [None req-91eabca7-4e91-4914-9f1f-a04511f7a9da tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Getting quotas for project 45bb3a603ddc4d3b8042b6ae687c896e. Resources: {'cores', 'instances', 'ram'} {{(pid=117685) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:21:40.929487 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.quota [None req-91eabca7-4e91-4914-9f1f-a04511f7a9da tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Getting quotas for user 3a1cd35a257f4b0f99141580c14bad48 and project 45bb3a603ddc4d3b8042b6ae687c896e. Resources: {'cores', 'instances', 'ram'} {{(pid=117685) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:21:40.941413 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-91eabca7-4e91-4914-9f1f-a04511f7a9da tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Going to run 1 instances... {{(pid=117685) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 11:21:40.943806 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-91eabca7-4e91-4914-9f1f-a04511f7a9da tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2321e9a0-fe0f-47fd-9c4b-8868eb5a00af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117685) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 11:21:40.950061 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-a439215d-a237-494a-bb6b-c01164acbcdd tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:40.960901 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-a439215d-a237-494a-bb6b-c01164acbcdd tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:40.963081 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-a439215d-a237-494a-bb6b-c01164acbcdd tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:40.964661 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-a439215d-a237-494a-bb6b-c01164acbcdd tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.177688 Aug 09 11:21:40.965221 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 277/583] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:21:40 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:21:40.998741 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-91eabca7-4e91-4914-9f1f-a04511f7a9da tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.631946 Aug 09 11:21:40.999387 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 307/584] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 9 11:21:40 2022] POST /compute/v2.1/servers => generated 408 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 11:21:41.010607 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-b8f9ab8c-f0c0-4b9e-8d4b-24debf07c4aa tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:41.011234 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-b8f9ab8c-f0c0-4b9e-8d4b-24debf07c4aa tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:41.069315 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-b8f9ab8c-f0c0-4b9e-8d4b-24debf07c4aa tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:41.076373 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-b8f9ab8c-f0c0-4b9e-8d4b-24debf07c4aa tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078" status: 200 len: 1244 microversion: 2.1 time: 0.069665 Aug 09 11:21:41.076936 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 278/585] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:41 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 => generated 1244 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:41.260850 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-0fa7afba-2fee-403a-a2a1-5d649b47036f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:41.261483 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-0fa7afba-2fee-403a-a2a1-5d649b47036f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:41.268822 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0fa7afba-2fee-403a-a2a1-5d649b47036f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:41.269298 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0fa7afba-2fee-403a-a2a1-5d649b47036f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:41.269731 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0fa7afba-2fee-403a-a2a1-5d649b47036f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:41.270413 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0fa7afba-2fee-403a-a2a1-5d649b47036f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:41.270855 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0fa7afba-2fee-403a-a2a1-5d649b47036f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:41.271266 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0fa7afba-2fee-403a-a2a1-5d649b47036f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:41.404710 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-0fa7afba-2fee-403a-a2a1-5d649b47036f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:41.412827 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-0fa7afba-2fee-403a-a2a1-5d649b47036f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1677 microversion: 2.1 time: 0.157303 Aug 09 11:21:41.413387 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 308/586] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:41 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:41.420602 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-196e49c6-e31e-4750-833d-d854a8a1e409 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:41.422838 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-196e49c6-e31e-4750-833d-d854a8a1e409 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 1329e8e9-9358-454d-bea3-dad19dfc53da] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:41.429846 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-196e49c6-e31e-4750-833d-d854a8a1e409 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:41.430895 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-196e49c6-e31e-4750-833d-d854a8a1e409 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:41.431331 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-196e49c6-e31e-4750-833d-d854a8a1e409 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:41.432023 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-196e49c6-e31e-4750-833d-d854a8a1e409 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:41.432508 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-196e49c6-e31e-4750-833d-d854a8a1e409 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:41.432931 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-196e49c6-e31e-4750-833d-d854a8a1e409 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:41.462168 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-196e49c6-e31e-4750-833d-d854a8a1e409 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048300 Aug 09 11:21:41.462745 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 279/587] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 9 11:21:41 2022] GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:21:41.988363 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-1e4980d5-9da8-44ec-9af4-7e3297107782 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:41.988859 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-1e4980d5-9da8-44ec-9af4-7e3297107782 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:41.995898 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1e4980d5-9da8-44ec-9af4-7e3297107782 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:41.996416 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1e4980d5-9da8-44ec-9af4-7e3297107782 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:41.996845 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1e4980d5-9da8-44ec-9af4-7e3297107782 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:41.997566 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1e4980d5-9da8-44ec-9af4-7e3297107782 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:41.997977 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1e4980d5-9da8-44ec-9af4-7e3297107782 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:41.998392 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1e4980d5-9da8-44ec-9af4-7e3297107782 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:42.097176 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-788398f4-efd2-4fd8-bf6a-5ce870bdcc4e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:42.097804 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-788398f4-efd2-4fd8-bf6a-5ce870bdcc4e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:42.104845 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-788398f4-efd2-4fd8-bf6a-5ce870bdcc4e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:42.105297 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-788398f4-efd2-4fd8-bf6a-5ce870bdcc4e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:42.105971 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-788398f4-efd2-4fd8-bf6a-5ce870bdcc4e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:42.106655 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-788398f4-efd2-4fd8-bf6a-5ce870bdcc4e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:42.107078 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-788398f4-efd2-4fd8-bf6a-5ce870bdcc4e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:42.107488 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-788398f4-efd2-4fd8-bf6a-5ce870bdcc4e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:42.155235 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-1e4980d5-9da8-44ec-9af4-7e3297107782 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:42.163710 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-1e4980d5-9da8-44ec-9af4-7e3297107782 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:42.165356 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-1e4980d5-9da8-44ec-9af4-7e3297107782 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:42.166974 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-1e4980d5-9da8-44ec-9af4-7e3297107782 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1807 microversion: 2.20 time: 0.182795 Aug 09 11:21:42.167572 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 309/588] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:21:41 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:21:42.170966 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-788398f4-efd2-4fd8-bf6a-5ce870bdcc4e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:42.178521 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-788398f4-efd2-4fd8-bf6a-5ce870bdcc4e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078" status: 200 len: 1248 microversion: 2.1 time: 0.085708 Aug 09 11:21:42.179106 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 280/589] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:42 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 => generated 1248 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:42.438140 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-05c8a323-e50e-4344-918f-8818cbc4f303 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:42.439180 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-05c8a323-e50e-4344-918f-8818cbc4f303 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:42.448828 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-05c8a323-e50e-4344-918f-8818cbc4f303 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:42.449302 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-05c8a323-e50e-4344-918f-8818cbc4f303 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:42.449732 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-05c8a323-e50e-4344-918f-8818cbc4f303 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:42.450412 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-05c8a323-e50e-4344-918f-8818cbc4f303 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:42.450853 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-05c8a323-e50e-4344-918f-8818cbc4f303 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:42.451251 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-05c8a323-e50e-4344-918f-8818cbc4f303 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:42.474812 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-276318dc-10fc-442f-b3a6-beec257bae69 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:42.477316 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-276318dc-10fc-442f-b3a6-beec257bae69 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 1329e8e9-9358-454d-bea3-dad19dfc53da] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:42.483725 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-276318dc-10fc-442f-b3a6-beec257bae69 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:42.484207 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-276318dc-10fc-442f-b3a6-beec257bae69 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:42.484661 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-276318dc-10fc-442f-b3a6-beec257bae69 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:42.485352 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-276318dc-10fc-442f-b3a6-beec257bae69 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:42.485824 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-276318dc-10fc-442f-b3a6-beec257bae69 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:42.486234 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-276318dc-10fc-442f-b3a6-beec257bae69 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:42.519395 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-276318dc-10fc-442f-b3a6-beec257bae69 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048668 Aug 09 11:21:42.520231 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 281/590] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 9 11:21:42 2022] GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:21:42.593496 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-05c8a323-e50e-4344-918f-8818cbc4f303 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:42.601315 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-05c8a323-e50e-4344-918f-8818cbc4f303 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1677 microversion: 2.1 time: 0.169879 Aug 09 11:21:42.602388 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 310/591] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:42 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:43.190611 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-24f9554d-d050-4f39-8758-5b7dd3d356c8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:43.191254 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-24f9554d-d050-4f39-8758-5b7dd3d356c8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:43.198768 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-24f9554d-d050-4f39-8758-5b7dd3d356c8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:43.199175 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-80bd4ce9-1d6c-4167-886a-c7f5957bbd11 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:43.199788 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-80bd4ce9-1d6c-4167-886a-c7f5957bbd11 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:43.200239 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-24f9554d-d050-4f39-8758-5b7dd3d356c8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:43.200854 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-24f9554d-d050-4f39-8758-5b7dd3d356c8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:43.201727 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-24f9554d-d050-4f39-8758-5b7dd3d356c8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:43.202361 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-24f9554d-d050-4f39-8758-5b7dd3d356c8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:43.203129 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-24f9554d-d050-4f39-8758-5b7dd3d356c8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:43.206713 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-80bd4ce9-1d6c-4167-886a-c7f5957bbd11 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:43.207417 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-80bd4ce9-1d6c-4167-886a-c7f5957bbd11 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:43.207859 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-80bd4ce9-1d6c-4167-886a-c7f5957bbd11 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:43.208607 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-80bd4ce9-1d6c-4167-886a-c7f5957bbd11 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:43.209050 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-80bd4ce9-1d6c-4167-886a-c7f5957bbd11 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:43.209453 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-80bd4ce9-1d6c-4167-886a-c7f5957bbd11 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:43.228128 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:21:43.293907 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-80bd4ce9-1d6c-4167-886a-c7f5957bbd11 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:43.303680 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-80bd4ce9-1d6c-4167-886a-c7f5957bbd11 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078" status: 200 len: 1296 microversion: 2.1 time: 0.108116 Aug 09 11:21:43.304467 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 311/592] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:43 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 => generated 1296 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:43.364819 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-24f9554d-d050-4f39-8758-5b7dd3d356c8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:43.373506 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-24f9554d-d050-4f39-8758-5b7dd3d356c8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:43.374987 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-24f9554d-d050-4f39-8758-5b7dd3d356c8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:43.376124 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-24f9554d-d050-4f39-8758-5b7dd3d356c8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1794 microversion: 2.20 time: 0.189687 Aug 09 11:21:43.376719 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 282/593] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:21:43 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1794 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:21:43.531874 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-2abe16cc-e796-4e7e-958b-f804b2774471 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:43.534198 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-2abe16cc-e796-4e7e-958b-f804b2774471 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 1329e8e9-9358-454d-bea3-dad19dfc53da] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:43.540910 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2abe16cc-e796-4e7e-958b-f804b2774471 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:43.541928 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2abe16cc-e796-4e7e-958b-f804b2774471 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:43.542362 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2abe16cc-e796-4e7e-958b-f804b2774471 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:43.543088 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2abe16cc-e796-4e7e-958b-f804b2774471 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:43.543530 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2abe16cc-e796-4e7e-958b-f804b2774471 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:43.543996 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2abe16cc-e796-4e7e-958b-f804b2774471 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:43.590628 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-2abe16cc-e796-4e7e-958b-f804b2774471 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062739 Aug 09 11:21:43.591492 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 312/594] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 9 11:21:43 2022] GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 11:21:43.622436 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-5c2ec801-f702-4f0b-a707-5a072f264249 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:43.623052 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-5c2ec801-f702-4f0b-a707-5a072f264249 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:43.632069 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5c2ec801-f702-4f0b-a707-5a072f264249 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:43.632650 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5c2ec801-f702-4f0b-a707-5a072f264249 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:43.634166 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5c2ec801-f702-4f0b-a707-5a072f264249 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:43.637280 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5c2ec801-f702-4f0b-a707-5a072f264249 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:43.637752 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5c2ec801-f702-4f0b-a707-5a072f264249 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:43.638199 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5c2ec801-f702-4f0b-a707-5a072f264249 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:43.659673 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-88bd5a8d-c9c4-47e0-a835-cac71d2e1ce3 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:43.660166 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-88bd5a8d-c9c4-47e0-a835-cac71d2e1ce3 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 1329e8e9-9358-454d-bea3-dad19dfc53da] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:43.666464 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-88bd5a8d-c9c4-47e0-a835-cac71d2e1ce3 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:43.666944 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-88bd5a8d-c9c4-47e0-a835-cac71d2e1ce3 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:43.667372 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-88bd5a8d-c9c4-47e0-a835-cac71d2e1ce3 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:43.668078 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-88bd5a8d-c9c4-47e0-a835-cac71d2e1ce3 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:43.668575 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-88bd5a8d-c9c4-47e0-a835-cac71d2e1ce3 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:43.669002 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-88bd5a8d-c9c4-47e0-a835-cac71d2e1ce3 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:43.699690 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-88bd5a8d-c9c4-47e0-a835-cac71d2e1ce3 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 1329e8e9-9358-454d-bea3-dad19dfc53da] Going to try to terminate instance {{(pid=117685) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 11:21:43.811558 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-5c2ec801-f702-4f0b-a707-5a072f264249 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:43.823868 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-5c2ec801-f702-4f0b-a707-5a072f264249 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1677 microversion: 2.1 time: 0.203793 Aug 09 11:21:43.825165 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 283/595] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:43 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1677 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:43.835941 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-88bd5a8d-c9c4-47e0-a835-cac71d2e1ce3 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da" status: 204 len: 0 microversion: 2.1 time: 0.171520 Aug 09 11:21:43.835941 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 313/596] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 9 11:21:43 2022] DELETE /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 11:21:43.840596 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-53be5018-4c1a-4d79-a2a8-32a6ffbb2995 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:43.841430 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-53be5018-4c1a-4d79-a2a8-32a6ffbb2995 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 1329e8e9-9358-454d-bea3-dad19dfc53da] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:43.849064 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-53be5018-4c1a-4d79-a2a8-32a6ffbb2995 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:43.849634 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-53be5018-4c1a-4d79-a2a8-32a6ffbb2995 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:43.850067 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-53be5018-4c1a-4d79-a2a8-32a6ffbb2995 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:43.850764 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-53be5018-4c1a-4d79-a2a8-32a6ffbb2995 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:43.851209 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-53be5018-4c1a-4d79-a2a8-32a6ffbb2995 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:43.851622 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-53be5018-4c1a-4d79-a2a8-32a6ffbb2995 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:43.987520 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-53be5018-4c1a-4d79-a2a8-32a6ffbb2995 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:43.996061 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-53be5018-4c1a-4d79-a2a8-32a6ffbb2995 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da" status: 200 len: 1682 microversion: 2.1 time: 0.161791 Aug 09 11:21:43.996679 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 314/597] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:43 2022] GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:44.329963 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-f2637f13-d24f-4182-9328-5ae3926802b3 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:44.330838 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-f2637f13-d24f-4182-9328-5ae3926802b3 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:44.340298 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f2637f13-d24f-4182-9328-5ae3926802b3 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:44.340788 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f2637f13-d24f-4182-9328-5ae3926802b3 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:44.341213 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f2637f13-d24f-4182-9328-5ae3926802b3 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:44.341892 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f2637f13-d24f-4182-9328-5ae3926802b3 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:44.342334 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f2637f13-d24f-4182-9328-5ae3926802b3 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:44.342745 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f2637f13-d24f-4182-9328-5ae3926802b3 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:44.409496 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-f2637f13-d24f-4182-9328-5ae3926802b3 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:44.417444 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-f2637f13-d24f-4182-9328-5ae3926802b3 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078" status: 200 len: 1302 microversion: 2.1 time: 0.094451 Aug 09 11:21:44.418008 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 284/598] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:44 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 => generated 1302 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:44.851394 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-581d9a78-1314-40da-96e6-195c2dceab8e tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:44.852477 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-581d9a78-1314-40da-96e6-195c2dceab8e tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:44.859982 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-581d9a78-1314-40da-96e6-195c2dceab8e tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:44.860509 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-581d9a78-1314-40da-96e6-195c2dceab8e tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:44.860946 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-581d9a78-1314-40da-96e6-195c2dceab8e tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:44.861638 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-581d9a78-1314-40da-96e6-195c2dceab8e tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:44.862083 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-581d9a78-1314-40da-96e6-195c2dceab8e tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:44.862506 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-581d9a78-1314-40da-96e6-195c2dceab8e tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:44.997077 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-581d9a78-1314-40da-96e6-195c2dceab8e tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:45.008913 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-581d9a78-1314-40da-96e6-195c2dceab8e tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1677 microversion: 2.1 time: 0.163697 Aug 09 11:21:45.009731 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 315/599] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:44 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:45.018540 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-f51c7a74-f305-4c9d-aa87-67bfd704452f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:45.019160 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-f51c7a74-f305-4c9d-aa87-67bfd704452f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 1329e8e9-9358-454d-bea3-dad19dfc53da] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:45.025565 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f51c7a74-f305-4c9d-aa87-67bfd704452f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:45.026062 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f51c7a74-f305-4c9d-aa87-67bfd704452f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:45.026496 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f51c7a74-f305-4c9d-aa87-67bfd704452f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:45.027187 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f51c7a74-f305-4c9d-aa87-67bfd704452f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:45.027619 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f51c7a74-f305-4c9d-aa87-67bfd704452f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:45.028033 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f51c7a74-f305-4c9d-aa87-67bfd704452f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:45.046162 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell1:SELECT=100 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:21:45.168343 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-f51c7a74-f305-4c9d-aa87-67bfd704452f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:45.176325 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-f51c7a74-f305-4c9d-aa87-67bfd704452f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da" status: 200 len: 1682 microversion: 2.1 time: 0.162009 Aug 09 11:21:45.176922 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 285/600] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:45 2022] GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:45.442536 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-ee8b1611-aba2-41f2-aa6b-99baa73b81d0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:45.443402 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-ee8b1611-aba2-41f2-aa6b-99baa73b81d0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:45.451816 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ee8b1611-aba2-41f2-aa6b-99baa73b81d0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:45.452314 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ee8b1611-aba2-41f2-aa6b-99baa73b81d0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:45.452744 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ee8b1611-aba2-41f2-aa6b-99baa73b81d0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:45.453423 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ee8b1611-aba2-41f2-aa6b-99baa73b81d0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:45.453866 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ee8b1611-aba2-41f2-aa6b-99baa73b81d0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:45.454283 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ee8b1611-aba2-41f2-aa6b-99baa73b81d0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:45.524800 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-ee8b1611-aba2-41f2-aa6b-99baa73b81d0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:45.532384 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-ee8b1611-aba2-41f2-aa6b-99baa73b81d0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078" status: 200 len: 1302 microversion: 2.1 time: 0.096416 Aug 09 11:21:45.532951 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 316/601] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:45 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 => generated 1302 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:46.033129 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-cc9721b8-e684-4ddb-bedf-9cdab28014f8 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:46.033696 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-cc9721b8-e684-4ddb-bedf-9cdab28014f8 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:46.037358 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:21:46.043050 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cc9721b8-e684-4ddb-bedf-9cdab28014f8 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:46.043522 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cc9721b8-e684-4ddb-bedf-9cdab28014f8 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:46.043945 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cc9721b8-e684-4ddb-bedf-9cdab28014f8 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:46.044778 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cc9721b8-e684-4ddb-bedf-9cdab28014f8 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:46.045385 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cc9721b8-e684-4ddb-bedf-9cdab28014f8 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:46.045985 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cc9721b8-e684-4ddb-bedf-9cdab28014f8 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:46.194179 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-cc9721b8-e684-4ddb-bedf-9cdab28014f8 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:46.198593 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-d8e4dc46-2b5d-43be-ad91-aec913d5ef6a tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:46.199173 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-d8e4dc46-2b5d-43be-ad91-aec913d5ef6a tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 1329e8e9-9358-454d-bea3-dad19dfc53da] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:46.202421 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-cc9721b8-e684-4ddb-bedf-9cdab28014f8 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1677 microversion: 2.1 time: 0.173501 Aug 09 11:21:46.203069 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 286/602] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:46 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:46.211061 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d8e4dc46-2b5d-43be-ad91-aec913d5ef6a tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:46.211651 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d8e4dc46-2b5d-43be-ad91-aec913d5ef6a tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:46.212113 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d8e4dc46-2b5d-43be-ad91-aec913d5ef6a tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:46.212852 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d8e4dc46-2b5d-43be-ad91-aec913d5ef6a tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:46.213350 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d8e4dc46-2b5d-43be-ad91-aec913d5ef6a tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:46.213768 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d8e4dc46-2b5d-43be-ad91-aec913d5ef6a tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:46.353421 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-d8e4dc46-2b5d-43be-ad91-aec913d5ef6a tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:46.361788 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-d8e4dc46-2b5d-43be-ad91-aec913d5ef6a tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da" status: 200 len: 1682 microversion: 2.1 time: 0.167343 Aug 09 11:21:46.362370 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 317/603] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:46 2022] GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:46.557306 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-56f12e82-4284-4434-92b3-bd0ee02d04f8 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:46.557941 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-56f12e82-4284-4434-92b3-bd0ee02d04f8 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:46.564631 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-56f12e82-4284-4434-92b3-bd0ee02d04f8 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:46.565107 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-56f12e82-4284-4434-92b3-bd0ee02d04f8 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:46.565523 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-56f12e82-4284-4434-92b3-bd0ee02d04f8 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:46.566213 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-56f12e82-4284-4434-92b3-bd0ee02d04f8 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:46.566658 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-56f12e82-4284-4434-92b3-bd0ee02d04f8 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:46.567074 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-56f12e82-4284-4434-92b3-bd0ee02d04f8 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:46.631094 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-56f12e82-4284-4434-92b3-bd0ee02d04f8 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:46.638941 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-56f12e82-4284-4434-92b3-bd0ee02d04f8 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078" status: 200 len: 1302 microversion: 2.1 time: 0.088241 Aug 09 11:21:46.639510 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 287/604] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:46 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 => generated 1302 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:47.223355 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-1c17d0cf-674b-48df-bdaa-6ebbbb42503b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:47.224329 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-1c17d0cf-674b-48df-bdaa-6ebbbb42503b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:47.232257 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1c17d0cf-674b-48df-bdaa-6ebbbb42503b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:47.232603 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1c17d0cf-674b-48df-bdaa-6ebbbb42503b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:47.233215 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1c17d0cf-674b-48df-bdaa-6ebbbb42503b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:47.233961 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1c17d0cf-674b-48df-bdaa-6ebbbb42503b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:47.234396 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1c17d0cf-674b-48df-bdaa-6ebbbb42503b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:47.234821 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1c17d0cf-674b-48df-bdaa-6ebbbb42503b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:47.379548 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-2a151516-ef1e-4539-abc4-0ccb6be844b9 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1207704082", "imageRef": "2321e9a0-fe0f-47fd-9c4b-8868eb5a00af", "flavorRef": "452", "networks": [{"uuid": "f9d31597-56ec-4fa4-8984-e0f122e23e6f"}]}} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:21:47.388343 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-1c17d0cf-674b-48df-bdaa-6ebbbb42503b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:47.396690 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-1c17d0cf-674b-48df-bdaa-6ebbbb42503b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1677 microversion: 2.1 time: 0.177341 Aug 09 11:21:47.397358 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 318/605] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:47 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1677 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:47.403318 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-c4e1a787-e46c-4a1d-8adb-23fc7afa0b64 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:47.404161 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-c4e1a787-e46c-4a1d-8adb-23fc7afa0b64 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 1329e8e9-9358-454d-bea3-dad19dfc53da] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:47.410532 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c4e1a787-e46c-4a1d-8adb-23fc7afa0b64 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:47.410708 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c4e1a787-e46c-4a1d-8adb-23fc7afa0b64 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:47.411318 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c4e1a787-e46c-4a1d-8adb-23fc7afa0b64 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:47.412018 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c4e1a787-e46c-4a1d-8adb-23fc7afa0b64 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:47.412673 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c4e1a787-e46c-4a1d-8adb-23fc7afa0b64 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:47.413018 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c4e1a787-e46c-4a1d-8adb-23fc7afa0b64 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:47.454567 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.network.neutron [None req-2a151516-ef1e-4539-abc4-0ccb6be844b9 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] validate_networks() for [('f9d31597-56ec-4fa4-8984-e0f122e23e6f', None, None, None, None, None)] {{(pid=117684) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 11:21:47.766884 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-c4e1a787-e46c-4a1d-8adb-23fc7afa0b64 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:47.775750 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-c4e1a787-e46c-4a1d-8adb-23fc7afa0b64 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da" status: 200 len: 1682 microversion: 2.1 time: 0.377016 Aug 09 11:21:47.789023 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 319/606] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:47 2022] GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da => generated 1682 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:47.797026 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-1a5473ea-79bc-4ba3-ad9e-bbba506e2e4c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:47.797976 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-1a5473ea-79bc-4ba3-ad9e-bbba506e2e4c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:47.807838 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1a5473ea-79bc-4ba3-ad9e-bbba506e2e4c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:47.808752 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1a5473ea-79bc-4ba3-ad9e-bbba506e2e4c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:47.809661 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1a5473ea-79bc-4ba3-ad9e-bbba506e2e4c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:47.810707 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1a5473ea-79bc-4ba3-ad9e-bbba506e2e4c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:47.811385 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1a5473ea-79bc-4ba3-ad9e-bbba506e2e4c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:47.812063 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1a5473ea-79bc-4ba3-ad9e-bbba506e2e4c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:48.150272 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-1a5473ea-79bc-4ba3-ad9e-bbba506e2e4c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:48.160416 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-1a5473ea-79bc-4ba3-ad9e-bbba506e2e4c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078" status: 200 len: 1369 microversion: 2.1 time: 0.370064 Aug 09 11:21:48.161638 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 320/607] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:47 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 => generated 1369 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:48.261410 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-3cc12853-7ad6-4881-8b7f-41392bd6828a req-6fdbdb56-22d2-456e-86f8-251501f0ac7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8009a1a2-4c8e-4953-ba5c-faab2db05078", "tag": "13fa53bd-98eb-4624-884c-1b14e8d98ae7"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:21:48.282426 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-3cc12853-7ad6-4881-8b7f-41392bd6828a req-6fdbdb56-22d2-456e-86f8-251501f0ac7a service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:48.283623 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-3cc12853-7ad6-4881-8b7f-41392bd6828a req-6fdbdb56-22d2-456e-86f8-251501f0ac7a service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:48.284211 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-3cc12853-7ad6-4881-8b7f-41392bd6828a req-6fdbdb56-22d2-456e-86f8-251501f0ac7a service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:48.301358 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-3cc12853-7ad6-4881-8b7f-41392bd6828a req-6fdbdb56-22d2-456e-86f8-251501f0ac7a service nova] Creating event network-changed:13fa53bd-98eb-4624-884c-1b14e8d98ae7 for instance 8009a1a2-4c8e-4953-ba5c-faab2db05078 on hv-cinder-85251 Aug 09 11:21:48.309043 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-3cc12853-7ad6-4881-8b7f-41392bd6828a req-6fdbdb56-22d2-456e-86f8-251501f0ac7a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054695 Aug 09 11:21:48.310216 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 321/608] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:21:48.350797 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-2a151516-ef1e-4539-abc4-0ccb6be844b9 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Flavor limits 0:0:0 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 11:21:48.351378 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-2a151516-ef1e-4539-abc4-0ccb6be844b9 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Image limits 0:0:0 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 11:21:48.352227 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-2a151516-ef1e-4539-abc4-0ccb6be844b9 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Flavor pref 0:0:0 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 11:21:48.353287 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-2a151516-ef1e-4539-abc4-0ccb6be844b9 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Image pref 0:0:0 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 11:21:48.354177 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-2a151516-ef1e-4539-abc4-0ccb6be844b9 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 11:21:48.363537 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2a151516-ef1e-4539-abc4-0ccb6be844b9 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:48.364032 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2a151516-ef1e-4539-abc4-0ccb6be844b9 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:48.364497 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2a151516-ef1e-4539-abc4-0ccb6be844b9 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:48.365225 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2a151516-ef1e-4539-abc4-0ccb6be844b9 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:48.365706 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2a151516-ef1e-4539-abc4-0ccb6be844b9 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:48.366101 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2a151516-ef1e-4539-abc4-0ccb6be844b9 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:48.383990 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.quota [None req-2a151516-ef1e-4539-abc4-0ccb6be844b9 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Getting quotas for project 7a2f6acb3c3a4b24be797a677d868227. Resources: {'cores', 'instances', 'ram'} {{(pid=117684) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:21:48.388115 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.quota [None req-2a151516-ef1e-4539-abc4-0ccb6be844b9 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Getting quotas for user ff3135cc1482461caf69068b659f49e4 and project 7a2f6acb3c3a4b24be797a677d868227. Resources: {'cores', 'instances', 'ram'} {{(pid=117684) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:21:48.400648 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-2a151516-ef1e-4539-abc4-0ccb6be844b9 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Going to run 1 instances... {{(pid=117684) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 11:21:48.403098 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-2a151516-ef1e-4539-abc4-0ccb6be844b9 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] [instance: b53460e2-2036-40d3-acfc-46ad41e98836] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2321e9a0-fe0f-47fd-9c4b-8868eb5a00af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117684) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 11:21:48.420086 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-45ed9158-0a89-430b-9d08-279dc73c8b92 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:48.420904 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-45ed9158-0a89-430b-9d08-279dc73c8b92 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:48.428302 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-45ed9158-0a89-430b-9d08-279dc73c8b92 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:48.429046 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-45ed9158-0a89-430b-9d08-279dc73c8b92 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:48.429858 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-45ed9158-0a89-430b-9d08-279dc73c8b92 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:48.430853 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-45ed9158-0a89-430b-9d08-279dc73c8b92 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:48.431332 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-45ed9158-0a89-430b-9d08-279dc73c8b92 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:48.432003 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-45ed9158-0a89-430b-9d08-279dc73c8b92 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:48.495128 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-2a151516-ef1e-4539-abc4-0ccb6be844b9 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.119146 Aug 09 11:21:48.496397 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 288/609] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 9 11:21:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1122 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 11:21:48.509167 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-c19a7627-39d2-42dc-a375-338f7f501ce3 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:48.511120 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-c19a7627-39d2-42dc-a375-338f7f501ce3 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] [instance: b53460e2-2036-40d3-acfc-46ad41e98836] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:48.624938 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-c19a7627-39d2-42dc-a375-338f7f501ce3 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff3135cc1482461caf69068b659f49e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2f6acb3c3a4b24be797a677d868227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:48.636113 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-c19a7627-39d2-42dc-a375-338f7f501ce3 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] 10.222.0.27 "GET /compute/v2.1/servers/b53460e2-2036-40d3-acfc-46ad41e98836" status: 200 len: 1219 microversion: 2.1 time: 0.133117 Aug 09 11:21:48.650042 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 289/610] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:48 2022] GET /compute/v2.1/servers/b53460e2-2036-40d3-acfc-46ad41e98836 => generated 1219 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:21:48.711370 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-45ed9158-0a89-430b-9d08-279dc73c8b92 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:48.722222 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-45ed9158-0a89-430b-9d08-279dc73c8b92 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1677 microversion: 2.1 time: 0.306338 Aug 09 11:21:48.723020 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 322/611] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:48 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1677 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:48.799618 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-09ec14fe-c587-462e-a242-d717c7313bee tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:48.800609 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-09ec14fe-c587-462e-a242-d717c7313bee tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 1329e8e9-9358-454d-bea3-dad19dfc53da] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:48.811775 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-09ec14fe-c587-462e-a242-d717c7313bee tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:48.812745 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-09ec14fe-c587-462e-a242-d717c7313bee tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:48.813778 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-09ec14fe-c587-462e-a242-d717c7313bee tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:48.814540 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-09ec14fe-c587-462e-a242-d717c7313bee tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:48.815523 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-09ec14fe-c587-462e-a242-d717c7313bee tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:48.816101 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-09ec14fe-c587-462e-a242-d717c7313bee tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:48.906197 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-09ec14fe-c587-462e-a242-d717c7313bee tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:48.915581 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-09ec14fe-c587-462e-a242-d717c7313bee tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da" status: 200 len: 1614 microversion: 2.1 time: 0.120244 Aug 09 11:21:48.916827 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 290/612] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:48 2022] GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da => generated 1614 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:48.989113 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-f8ed6e34-62cd-4c22-aa98-f7a2fc6f0ba8 req-cc3315db-1b8c-4149-b1ac-2295ce8e7c53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1329e8e9-9358-454d-bea3-dad19dfc53da", "name": "network-vif-deleted", "tag": "b3947c96-3346-4577-96e3-f0591b58e37f"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:21:49.001845 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-f8ed6e34-62cd-4c22-aa98-f7a2fc6f0ba8 req-cc3315db-1b8c-4149-b1ac-2295ce8e7c53 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:49.002425 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-f8ed6e34-62cd-4c22-aa98-f7a2fc6f0ba8 req-cc3315db-1b8c-4149-b1ac-2295ce8e7c53 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:49.002916 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-f8ed6e34-62cd-4c22-aa98-f7a2fc6f0ba8 req-cc3315db-1b8c-4149-b1ac-2295ce8e7c53 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:49.015271 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-f8ed6e34-62cd-4c22-aa98-f7a2fc6f0ba8 req-cc3315db-1b8c-4149-b1ac-2295ce8e7c53 service nova] Creating event network-vif-deleted:b3947c96-3346-4577-96e3-f0591b58e37f for instance 1329e8e9-9358-454d-bea3-dad19dfc53da on hv-cinder-85251 Aug 09 11:21:49.021436 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-f8ed6e34-62cd-4c22-aa98-f7a2fc6f0ba8 req-cc3315db-1b8c-4149-b1ac-2295ce8e7c53 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035939 Aug 09 11:21:49.022050 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 323/613] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:21:49.181012 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-d4a4bcd6-a2ef-4f32-afae-a688b948a367 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:49.181624 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-d4a4bcd6-a2ef-4f32-afae-a688b948a367 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:49.188004 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d4a4bcd6-a2ef-4f32-afae-a688b948a367 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:49.188528 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d4a4bcd6-a2ef-4f32-afae-a688b948a367 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:49.188965 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d4a4bcd6-a2ef-4f32-afae-a688b948a367 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:49.189642 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d4a4bcd6-a2ef-4f32-afae-a688b948a367 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:49.190094 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d4a4bcd6-a2ef-4f32-afae-a688b948a367 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:49.190549 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d4a4bcd6-a2ef-4f32-afae-a688b948a367 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:49.320918 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-d4a4bcd6-a2ef-4f32-afae-a688b948a367 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:49.328895 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-d4a4bcd6-a2ef-4f32-afae-a688b948a367 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078" status: 200 len: 1369 microversion: 2.1 time: 0.151755 Aug 09 11:21:49.329463 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 291/614] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:49 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 => generated 1369 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:49.660114 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-0ec35f19-4547-418a-a2f1-d74a739d4290 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:49.661044 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-0ec35f19-4547-418a-a2f1-d74a739d4290 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] [instance: b53460e2-2036-40d3-acfc-46ad41e98836] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:49.668785 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0ec35f19-4547-418a-a2f1-d74a739d4290 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:49.669432 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0ec35f19-4547-418a-a2f1-d74a739d4290 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:49.670056 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0ec35f19-4547-418a-a2f1-d74a739d4290 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:49.670991 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0ec35f19-4547-418a-a2f1-d74a739d4290 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:49.671433 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0ec35f19-4547-418a-a2f1-d74a739d4290 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:49.671848 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0ec35f19-4547-418a-a2f1-d74a739d4290 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:49.739056 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-0ec35f19-4547-418a-a2f1-d74a739d4290 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff3135cc1482461caf69068b659f49e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2f6acb3c3a4b24be797a677d868227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:49.743287 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-2cbe9f95-b12c-46af-9119-debaad2c791b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:49.746023 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-2cbe9f95-b12c-46af-9119-debaad2c791b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:49.747861 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-0ec35f19-4547-418a-a2f1-d74a739d4290 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] 10.222.0.27 "GET /compute/v2.1/servers/b53460e2-2036-40d3-acfc-46ad41e98836" status: 200 len: 1223 microversion: 2.1 time: 0.092494 Aug 09 11:21:49.750584 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 324/615] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:49 2022] GET /compute/v2.1/servers/b53460e2-2036-40d3-acfc-46ad41e98836 => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:49.756045 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2cbe9f95-b12c-46af-9119-debaad2c791b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:49.756644 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2cbe9f95-b12c-46af-9119-debaad2c791b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:49.757085 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2cbe9f95-b12c-46af-9119-debaad2c791b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:49.757783 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2cbe9f95-b12c-46af-9119-debaad2c791b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:49.758223 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2cbe9f95-b12c-46af-9119-debaad2c791b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:49.758638 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2cbe9f95-b12c-46af-9119-debaad2c791b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:49.937809 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-7c2444fc-4ce2-4ecd-b1de-ff73712e2ea6 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:49.938868 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-7c2444fc-4ce2-4ecd-b1de-ff73712e2ea6 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 1329e8e9-9358-454d-bea3-dad19dfc53da] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:49.945374 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7c2444fc-4ce2-4ecd-b1de-ff73712e2ea6 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:49.946391 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7c2444fc-4ce2-4ecd-b1de-ff73712e2ea6 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:49.946501 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7c2444fc-4ce2-4ecd-b1de-ff73712e2ea6 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:49.947327 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7c2444fc-4ce2-4ecd-b1de-ff73712e2ea6 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:49.947832 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7c2444fc-4ce2-4ecd-b1de-ff73712e2ea6 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:49.948254 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7c2444fc-4ce2-4ecd-b1de-ff73712e2ea6 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:49.983149 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7c2444fc-4ce2-4ecd-b1de-ff73712e2ea6 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:49.983887 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7c2444fc-4ce2-4ecd-b1de-ff73712e2ea6 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:49.984598 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7c2444fc-4ce2-4ecd-b1de-ff73712e2ea6 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:49.985216 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.objects.instance [None req-7c2444fc-4ce2-4ecd-b1de-ff73712e2ea6 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lazy-loading 'fault' on Instance uuid 1329e8e9-9358-454d-bea3-dad19dfc53da {{(pid=117685) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:21:50.049716 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-2cbe9f95-b12c-46af-9119-debaad2c791b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:50.059799 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-2cbe9f95-b12c-46af-9119-debaad2c791b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1677 microversion: 2.1 time: 0.319900 Aug 09 11:21:50.073504 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 292/616] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:49 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1677 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:50.075764 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-7c2444fc-4ce2-4ecd-b1de-ff73712e2ea6 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:50.084045 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-7c2444fc-4ce2-4ecd-b1de-ff73712e2ea6 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da" status: 200 len: 1331 microversion: 2.1 time: 0.150168 Aug 09 11:21:50.084726 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 325/617] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:49 2022] GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da => generated 1331 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:50.349868 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-a0b2cb8f-47ce-4c3a-a5a8-bc1cacee9b7d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:50.350474 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-a0b2cb8f-47ce-4c3a-a5a8-bc1cacee9b7d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:50.357465 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a0b2cb8f-47ce-4c3a-a5a8-bc1cacee9b7d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:50.357950 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a0b2cb8f-47ce-4c3a-a5a8-bc1cacee9b7d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:50.358383 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a0b2cb8f-47ce-4c3a-a5a8-bc1cacee9b7d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:50.359090 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a0b2cb8f-47ce-4c3a-a5a8-bc1cacee9b7d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:50.359569 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a0b2cb8f-47ce-4c3a-a5a8-bc1cacee9b7d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:50.359986 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a0b2cb8f-47ce-4c3a-a5a8-bc1cacee9b7d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:50.498800 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-a0b2cb8f-47ce-4c3a-a5a8-bc1cacee9b7d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:50.511233 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-a0b2cb8f-47ce-4c3a-a5a8-bc1cacee9b7d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078" status: 200 len: 1369 microversion: 2.1 time: 0.165125 Aug 09 11:21:50.512105 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 293/618] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:50 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 => generated 1369 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:50.771170 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-227f7316-fce5-4a05-bab9-70759769901d tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:50.772633 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-227f7316-fce5-4a05-bab9-70759769901d tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] [instance: b53460e2-2036-40d3-acfc-46ad41e98836] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:50.782266 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-227f7316-fce5-4a05-bab9-70759769901d tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:50.783026 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-227f7316-fce5-4a05-bab9-70759769901d tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:50.783675 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-227f7316-fce5-4a05-bab9-70759769901d tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:50.784647 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-227f7316-fce5-4a05-bab9-70759769901d tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:50.785424 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-227f7316-fce5-4a05-bab9-70759769901d tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:50.786031 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-227f7316-fce5-4a05-bab9-70759769901d tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:50.868866 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-227f7316-fce5-4a05-bab9-70759769901d tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff3135cc1482461caf69068b659f49e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2f6acb3c3a4b24be797a677d868227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:50.878186 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-227f7316-fce5-4a05-bab9-70759769901d tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] 10.222.0.27 "GET /compute/v2.1/servers/b53460e2-2036-40d3-acfc-46ad41e98836" status: 200 len: 1277 microversion: 2.1 time: 0.111540 Aug 09 11:21:50.878795 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 326/619] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:50 2022] GET /compute/v2.1/servers/b53460e2-2036-40d3-acfc-46ad41e98836 => generated 1277 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:51.085991 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-97a72afb-f7bd-470c-82eb-f8d03267d2e7 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:51.086601 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-97a72afb-f7bd-470c-82eb-f8d03267d2e7 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:51.105861 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-97a72afb-f7bd-470c-82eb-f8d03267d2e7 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:51.106229 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-b08db7e7-02ff-4e1e-b708-ce2e2827e02e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:51.106394 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-97a72afb-f7bd-470c-82eb-f8d03267d2e7 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:51.106730 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-97a72afb-f7bd-470c-82eb-f8d03267d2e7 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:51.107171 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-b08db7e7-02ff-4e1e-b708-ce2e2827e02e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 1329e8e9-9358-454d-bea3-dad19dfc53da] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:51.107455 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-97a72afb-f7bd-470c-82eb-f8d03267d2e7 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:51.107879 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-97a72afb-f7bd-470c-82eb-f8d03267d2e7 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:51.108316 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-97a72afb-f7bd-470c-82eb-f8d03267d2e7 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:51.109425 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell0:SELECT=2 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:21:51.110486 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell0:SELECT=6 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:21:51.116138 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b08db7e7-02ff-4e1e-b708-ce2e2827e02e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:51.116624 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b08db7e7-02ff-4e1e-b708-ce2e2827e02e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:51.117100 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b08db7e7-02ff-4e1e-b708-ce2e2827e02e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:51.117801 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b08db7e7-02ff-4e1e-b708-ce2e2827e02e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:51.118457 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b08db7e7-02ff-4e1e-b708-ce2e2827e02e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:51.118865 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b08db7e7-02ff-4e1e-b708-ce2e2827e02e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:51.134413 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.wsgi [None req-b08db7e7-02ff-4e1e-b708-ce2e2827e02e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] HTTP exception thrown: Instance 1329e8e9-9358-454d-bea3-dad19dfc53da could not be found. Aug 09 11:21:51.136398 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-b08db7e7-02ff-4e1e-b708-ce2e2827e02e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Request method failure captured: Aug 09 11:21:51.136398 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: request: GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da HTTP/1.1 Aug 09 11:21:51.136398 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Accept: application/json Aug 09 11:21:51.136398 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Accept-Encoding: identity Aug 09 11:21:51.136398 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Connection: close Aug 09 11:21:51.136398 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Content-Length: 0 Aug 09 11:21:51.136398 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Content-Type: application/json Aug 09 11:21:51.136398 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Host: 10.222.0.27 Aug 09 11:21:51.136398 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Openstack-System-Scope: None Aug 09 11:21:51.136398 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: User-Agent: python-urllib3/1.26.11 Aug 09 11:21:51.136398 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Auth-Token: gAAAAABi8kJrkCuZ0ZtlZIUmAC-EK2I0okp8exzRXbUBoHrpFGaG17TfS3kn4sSvkBzyMOMoCBQBmvOs9UrhF5xw2U46aP5Pxlq5Kj8piUuPsDzn7s8ETM_3P18gyColYBDIhcjSMUGohuoeVN3S8QIKYIofZURyiH1QY4Vi6NWdxWuymPkih0k Aug 09 11:21:51.136398 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Domain-Id: None Aug 09 11:21:51.136398 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Domain-Name: None Aug 09 11:21:51.136398 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Identity-Status: Confirmed Aug 09 11:21:51.136398 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Is-Admin-Project: True Aug 09 11:21:51.136398 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Domain-Id: default Aug 09 11:21:51.136398 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Domain-Name: Default Aug 09 11:21:51.136398 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Id: cba1dd0b689b4fff847b6fd3787b143c Aug 09 11:21:51.136398 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Name: tempest-AttachVolumeNegativeTest-1410930012 Aug 09 11:21:51.136398 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Role: member,reader Aug 09 11:21:51.136398 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Roles: member,reader Aug 09 11:21:51.138084 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:21:51.138084 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant: tempest-AttachVolumeNegativeTest-1410930012 Aug 09 11:21:51.138084 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant-Id: cba1dd0b689b4fff847b6fd3787b143c Aug 09 11:21:51.138084 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1410930012 Aug 09 11:21:51.138084 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User: tempest-AttachVolumeNegativeTest-1410930012-project Aug 09 11:21:51.138084 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Domain-Id: default Aug 09 11:21:51.138084 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Domain-Name: Default Aug 09 11:21:51.138084 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Id: f4da6dd860bb45d1a703a18c2512ffe4 Aug 09 11:21:51.138084 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Name: tempest-AttachVolumeNegativeTest-1410930012-project Aug 09 11:21:51.138084 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: method: > Aug 09 11:21:51.138084 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: exception: Instance 1329e8e9-9358-454d-bea3-dad19dfc53da could not be found. Aug 09 11:21:51.138084 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: action_args: {'id': '1329e8e9-9358-454d-bea3-dad19dfc53da'} Aug 09 11:21:51.138893 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:21:51.138893 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:21:51.138893 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:21:51.138893 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:21:51.138893 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:21:51.138893 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:21:51.138893 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:21:51.138893 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:21:51.138893 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:21:51.138893 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:21:51.138893 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1329e8e9-9358-454d-bea3-dad19dfc53da could not be found. Aug 09 11:21:51.138893 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:21:51.138893 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:21:51.138893 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:21:51.138893 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:21:51.138893 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:21:51.138893 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:21:51.138893 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:21:51.138893 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:21:51.138893 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:21:51.141639 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:21:51.141639 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:21:51.141639 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:21:51.141639 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:21:51.141639 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:21:51.141639 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:21:51.141639 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:21:51.141639 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1329e8e9-9358-454d-bea3-dad19dfc53da could not be found. Aug 09 11:21:51.141639 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:21:51.141639 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:21:51.141639 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:21:51.141639 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:21:51.141639 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:21:51.141639 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:21:51.141639 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:21:51.141639 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:21:51.141639 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1329e8e9-9358-454d-bea3-dad19dfc53da could not be found. Aug 09 11:21:51.141639 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:21:51.145298 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-b08db7e7-02ff-4e1e-b708-ce2e2827e02e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Returning 404 to user: Instance 1329e8e9-9358-454d-bea3-dad19dfc53da could not be found. {{(pid=117685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:21:51.145298 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-b08db7e7-02ff-4e1e-b708-ce2e2827e02e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da" status: 404 len: 111 microversion: 2.1 time: 0.035874 Aug 09 11:21:51.145298 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 327/620] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:51 2022] GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 11:21:51.148732 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-bd1d2bba-b7c3-4f3b-be52-d111e2ed4b54 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '.version_select at 0x7f2821ea6160>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:51.171982 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-bd1d2bba-b7c3-4f3b-be52-d111e2ed4b54 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-404780984" status: 202 len: 0 microversion: 2.1 time: 0.028147 Aug 09 11:21:51.172894 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 328/621] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Aug 9 11:21:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-404780984 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:21:51.264962 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-97a72afb-f7bd-470c-82eb-f8d03267d2e7 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:51.273546 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-97a72afb-f7bd-470c-82eb-f8d03267d2e7 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1677 microversion: 2.1 time: 0.191363 Aug 09 11:21:51.276456 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 294/622] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:51 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1677 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:51.533913 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-3ab634f5-f1be-4bfa-93b4-04d7c411eb73 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:51.534796 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-3ab634f5-f1be-4bfa-93b4-04d7c411eb73 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:51.543147 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3ab634f5-f1be-4bfa-93b4-04d7c411eb73 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:51.544012 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3ab634f5-f1be-4bfa-93b4-04d7c411eb73 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:51.544665 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3ab634f5-f1be-4bfa-93b4-04d7c411eb73 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:51.545584 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3ab634f5-f1be-4bfa-93b4-04d7c411eb73 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:51.546084 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3ab634f5-f1be-4bfa-93b4-04d7c411eb73 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:51.546690 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3ab634f5-f1be-4bfa-93b4-04d7c411eb73 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:51.554896 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:21:51.900735 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-c2f3e655-4599-45b6-bae7-a2b5b8599976 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:51.901637 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-c2f3e655-4599-45b6-bae7-a2b5b8599976 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] [instance: b53460e2-2036-40d3-acfc-46ad41e98836] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:51.908624 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c2f3e655-4599-45b6-bae7-a2b5b8599976 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:51.909108 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c2f3e655-4599-45b6-bae7-a2b5b8599976 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:51.909708 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c2f3e655-4599-45b6-bae7-a2b5b8599976 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:51.910553 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c2f3e655-4599-45b6-bae7-a2b5b8599976 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:51.911278 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c2f3e655-4599-45b6-bae7-a2b5b8599976 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:51.912001 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c2f3e655-4599-45b6-bae7-a2b5b8599976 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:52.062715 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-3ab634f5-f1be-4bfa-93b4-04d7c411eb73 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:52.072159 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-3ab634f5-f1be-4bfa-93b4-04d7c411eb73 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078" status: 200 len: 1369 microversion: 2.1 time: 0.541946 Aug 09 11:21:52.096151 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 329/623] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:51 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 => generated 1369 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:52.102441 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-d0b0beed-e41d-4fbe-a1e2-d81faa67921c req-3543bed1-9825-4b5d-b6e1-b9f01fbcc812 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b53460e2-2036-40d3-acfc-46ad41e98836", "tag": "698bd695-580e-4f6d-8280-7cdeba7f5874"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:21:52.116524 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-d0b0beed-e41d-4fbe-a1e2-d81faa67921c req-3543bed1-9825-4b5d-b6e1-b9f01fbcc812 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:52.117899 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-d0b0beed-e41d-4fbe-a1e2-d81faa67921c req-3543bed1-9825-4b5d-b6e1-b9f01fbcc812 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:52.118766 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-d0b0beed-e41d-4fbe-a1e2-d81faa67921c req-3543bed1-9825-4b5d-b6e1-b9f01fbcc812 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:52.133014 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-d0b0beed-e41d-4fbe-a1e2-d81faa67921c req-3543bed1-9825-4b5d-b6e1-b9f01fbcc812 service nova] Creating event network-changed:698bd695-580e-4f6d-8280-7cdeba7f5874 for instance b53460e2-2036-40d3-acfc-46ad41e98836 on hv-cinder-85251 Aug 09 11:21:52.153019 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-d0b0beed-e41d-4fbe-a1e2-d81faa67921c req-3543bed1-9825-4b5d-b6e1-b9f01fbcc812 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054580 Aug 09 11:21:52.154002 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 330/624] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:21:52.177112 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-c2f3e655-4599-45b6-bae7-a2b5b8599976 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff3135cc1482461caf69068b659f49e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2f6acb3c3a4b24be797a677d868227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:52.185789 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-c2f3e655-4599-45b6-bae7-a2b5b8599976 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] 10.222.0.27 "GET /compute/v2.1/servers/b53460e2-2036-40d3-acfc-46ad41e98836" status: 200 len: 1319 microversion: 2.1 time: 0.290225 Aug 09 11:21:52.202094 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 295/625] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:51 2022] GET /compute/v2.1/servers/b53460e2-2036-40d3-acfc-46ad41e98836 => generated 1319 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:52.296202 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-79b48b61-b6da-4668-89a9-9b61f5590c91 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:52.297036 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-79b48b61-b6da-4668-89a9-9b61f5590c91 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:52.310533 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-79b48b61-b6da-4668-89a9-9b61f5590c91 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:52.311446 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-79b48b61-b6da-4668-89a9-9b61f5590c91 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:52.312831 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-79b48b61-b6da-4668-89a9-9b61f5590c91 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:52.313654 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-79b48b61-b6da-4668-89a9-9b61f5590c91 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:52.314953 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-79b48b61-b6da-4668-89a9-9b61f5590c91 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:52.315451 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-79b48b61-b6da-4668-89a9-9b61f5590c91 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:52.432522 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-0e5c5101-3296-4fa6-88c1-04c3f1d66b4f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Action: 'create', calling method: .version_select at 0x7f2821ed6820>, body: {"keypair": {"name": "tempest-keypair-583137067", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA5Ixf61efH8d/W55UGvBcY0X54rCgpwuiRdYkk4EsjKBgKZM9y7h1Jxvd0dSK3Z3efJUp0z+a5WHrBqMWG5Wgnk93zzAi3PJO034Kef2hXMdnkE2ys9AGygpk1wMZVTJw=="}} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:21:52.452205 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.quota [None req-0e5c5101-3296-4fa6-88c1-04c3f1d66b4f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Getting quotas for project cba1dd0b689b4fff847b6fd3787b143c. Resources: {'key_pairs'} {{(pid=117684) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:21:52.457601 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.quota [None req-0e5c5101-3296-4fa6-88c1-04c3f1d66b4f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Getting quotas for user f4da6dd860bb45d1a703a18c2512ffe4 and project cba1dd0b689b4fff847b6fd3787b143c. Resources: {'key_pairs'} {{(pid=117684) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:21:52.474464 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-79b48b61-b6da-4668-89a9-9b61f5590c91 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:52.483191 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-79b48b61-b6da-4668-89a9-9b61f5590c91 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1654 microversion: 2.1 time: 0.191633 Aug 09 11:21:52.483863 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 331/626] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:52 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1654 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:21:52.489814 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-0e5c5101-3296-4fa6-88c1-04c3f1d66b4f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.061465 Aug 09 11:21:52.490697 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 296/627] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 9 11:21:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:21:52.504403 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-7571c6c3-da5e-464a-990c-f18da4a4731a tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:21:52.506450 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:21:52.512711 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7571c6c3-da5e-464a-990c-f18da4a4731a tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:52.513216 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7571c6c3-da5e-464a-990c-f18da4a4731a tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:52.513632 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7571c6c3-da5e-464a-990c-f18da4a4731a tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:52.538217 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-7571c6c3-da5e-464a-990c-f18da4a4731a tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Going to try to start instance {{(pid=117685) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 09 11:21:52.591173 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-7571c6c3-da5e-464a-990c-f18da4a4731a tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "POST /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f/action" status: 202 len: 0 microversion: 2.1 time: 0.090391 Aug 09 11:21:52.592214 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 332/628] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 9 11:21:52 2022] POST /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 11:21:52.602601 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-5b9a0114-bbe9-4b03-81e4-1baa265ea398 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:52.604165 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-5b9a0114-bbe9-4b03-81e4-1baa265ea398 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:52.611899 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5b9a0114-bbe9-4b03-81e4-1baa265ea398 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:52.612464 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5b9a0114-bbe9-4b03-81e4-1baa265ea398 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:52.613126 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5b9a0114-bbe9-4b03-81e4-1baa265ea398 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:52.614056 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5b9a0114-bbe9-4b03-81e4-1baa265ea398 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:52.614470 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5b9a0114-bbe9-4b03-81e4-1baa265ea398 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:52.615191 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5b9a0114-bbe9-4b03-81e4-1baa265ea398 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:52.933120 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-5b9a0114-bbe9-4b03-81e4-1baa265ea398 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:52.941555 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-5b9a0114-bbe9-4b03-81e4-1baa265ea398 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1663 microversion: 2.1 time: 0.344514 Aug 09 11:21:52.954148 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 297/629] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:52 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1663 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:53.098921 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-9f198e6b-ec7f-43cf-ad64-dd11a77e60c0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:53.099625 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-9f198e6b-ec7f-43cf-ad64-dd11a77e60c0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:53.106302 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9f198e6b-ec7f-43cf-ad64-dd11a77e60c0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:53.106994 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9f198e6b-ec7f-43cf-ad64-dd11a77e60c0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:53.107260 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9f198e6b-ec7f-43cf-ad64-dd11a77e60c0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:53.108410 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9f198e6b-ec7f-43cf-ad64-dd11a77e60c0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:53.109200 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9f198e6b-ec7f-43cf-ad64-dd11a77e60c0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:53.109708 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9f198e6b-ec7f-43cf-ad64-dd11a77e60c0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:53.209842 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-1430fd55-6839-46e2-a373-31bbd850f727 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:53.211358 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-1430fd55-6839-46e2-a373-31bbd850f727 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] [instance: b53460e2-2036-40d3-acfc-46ad41e98836] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:53.226567 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1430fd55-6839-46e2-a373-31bbd850f727 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:53.227284 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1430fd55-6839-46e2-a373-31bbd850f727 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:53.228119 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1430fd55-6839-46e2-a373-31bbd850f727 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:53.229789 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1430fd55-6839-46e2-a373-31bbd850f727 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:53.230506 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1430fd55-6839-46e2-a373-31bbd850f727 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:53.231426 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1430fd55-6839-46e2-a373-31bbd850f727 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:53.318733 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-9f198e6b-ec7f-43cf-ad64-dd11a77e60c0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:53.327765 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-9f198e6b-ec7f-43cf-ad64-dd11a77e60c0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078" status: 200 len: 1369 microversion: 2.1 time: 0.233658 Aug 09 11:21:53.328630 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 333/630] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:53 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 => generated 1369 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:53.334192 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-b09a5f9c-9e84-44c2-b25b-caac49a8c127 req-11556f0d-35ca-4659-bc9c-005c7f7323c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8009a1a2-4c8e-4953-ba5c-faab2db05078", "name": "network-vif-plugged", "status": "completed", "tag": "13fa53bd-98eb-4624-884c-1b14e8d98ae7"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:21:53.345730 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-b09a5f9c-9e84-44c2-b25b-caac49a8c127 req-11556f0d-35ca-4659-bc9c-005c7f7323c6 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:53.346250 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-b09a5f9c-9e84-44c2-b25b-caac49a8c127 req-11556f0d-35ca-4659-bc9c-005c7f7323c6 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:53.346780 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-b09a5f9c-9e84-44c2-b25b-caac49a8c127 req-11556f0d-35ca-4659-bc9c-005c7f7323c6 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:53.359540 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-b09a5f9c-9e84-44c2-b25b-caac49a8c127 req-11556f0d-35ca-4659-bc9c-005c7f7323c6 service nova] Creating event network-vif-plugged:13fa53bd-98eb-4624-884c-1b14e8d98ae7 for instance 8009a1a2-4c8e-4953-ba5c-faab2db05078 on hv-cinder-85251 Aug 09 11:21:53.365347 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-b09a5f9c-9e84-44c2-b25b-caac49a8c127 req-11556f0d-35ca-4659-bc9c-005c7f7323c6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035279 Aug 09 11:21:53.366148 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 334/631] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:21:53.402842 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-1430fd55-6839-46e2-a373-31bbd850f727 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff3135cc1482461caf69068b659f49e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2f6acb3c3a4b24be797a677d868227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:53.411069 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-1430fd55-6839-46e2-a373-31bbd850f727 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] 10.222.0.27 "GET /compute/v2.1/servers/b53460e2-2036-40d3-acfc-46ad41e98836" status: 200 len: 1319 microversion: 2.1 time: 0.207161 Aug 09 11:21:53.411666 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 298/632] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:53 2022] GET /compute/v2.1/servers/b53460e2-2036-40d3-acfc-46ad41e98836 => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:53.964742 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-9bd9759e-eb57-4e0d-8cf5-5090e3ae45f6 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:53.965474 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-9bd9759e-eb57-4e0d-8cf5-5090e3ae45f6 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:53.972248 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9bd9759e-eb57-4e0d-8cf5-5090e3ae45f6 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:53.972954 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9bd9759e-eb57-4e0d-8cf5-5090e3ae45f6 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:53.973363 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9bd9759e-eb57-4e0d-8cf5-5090e3ae45f6 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:53.974095 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9bd9759e-eb57-4e0d-8cf5-5090e3ae45f6 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:53.974544 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9bd9759e-eb57-4e0d-8cf5-5090e3ae45f6 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:53.974963 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9bd9759e-eb57-4e0d-8cf5-5090e3ae45f6 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:54.227070 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-9bd9759e-eb57-4e0d-8cf5-5090e3ae45f6 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:54.236057 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-9bd9759e-eb57-4e0d-8cf5-5090e3ae45f6 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1663 microversion: 2.1 time: 0.276289 Aug 09 11:21:54.236977 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 335/633] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:53 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1663 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:54.356616 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-0400588d-3fe3-4575-9b9b-dfc39f024bad tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:54.357855 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-0400588d-3fe3-4575-9b9b-dfc39f024bad tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:54.370918 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0400588d-3fe3-4575-9b9b-dfc39f024bad tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:54.371403 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0400588d-3fe3-4575-9b9b-dfc39f024bad tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:54.371912 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0400588d-3fe3-4575-9b9b-dfc39f024bad tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:54.372645 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0400588d-3fe3-4575-9b9b-dfc39f024bad tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:54.373087 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0400588d-3fe3-4575-9b9b-dfc39f024bad tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:54.373499 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0400588d-3fe3-4575-9b9b-dfc39f024bad tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:54.434807 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-ea438ea4-7cfa-40a2-95b4-71486949ae49 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:54.436036 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-ea438ea4-7cfa-40a2-95b4-71486949ae49 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] [instance: b53460e2-2036-40d3-acfc-46ad41e98836] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:54.446129 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ea438ea4-7cfa-40a2-95b4-71486949ae49 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:54.446849 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ea438ea4-7cfa-40a2-95b4-71486949ae49 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:54.447502 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ea438ea4-7cfa-40a2-95b4-71486949ae49 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:54.448586 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ea438ea4-7cfa-40a2-95b4-71486949ae49 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:54.450495 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ea438ea4-7cfa-40a2-95b4-71486949ae49 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:54.451135 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ea438ea4-7cfa-40a2-95b4-71486949ae49 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:54.582389 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-0400588d-3fe3-4575-9b9b-dfc39f024bad tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:54.595805 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-0400588d-3fe3-4575-9b9b-dfc39f024bad tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078" status: 200 len: 1369 microversion: 2.1 time: 0.246316 Aug 09 11:21:54.596460 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 299/634] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:54 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 => generated 1369 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:54.602100 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-2a181450-c4a6-48d4-89e5-56ffb15e8492 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2032812658", "imageRef": "2321e9a0-fe0f-47fd-9c4b-8868eb5a00af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9bf85ef7-1c92-4e5f-a5b9-fcad7da95bf2"}], "security_groups": [{"name": "tempest-securitygroup--1806935800"}], "key_name": "tempest-keypair-583137067", "user_data": "}} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:21:54.645140 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-ea438ea4-7cfa-40a2-95b4-71486949ae49 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff3135cc1482461caf69068b659f49e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2f6acb3c3a4b24be797a677d868227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:54.654021 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-ea438ea4-7cfa-40a2-95b4-71486949ae49 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] 10.222.0.27 "GET /compute/v2.1/servers/b53460e2-2036-40d3-acfc-46ad41e98836" status: 200 len: 1319 microversion: 2.1 time: 0.226677 Aug 09 11:21:54.656316 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 336/635] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:54 2022] GET /compute/v2.1/servers/b53460e2-2036-40d3-acfc-46ad41e98836 => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:21:54.719524 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.network.neutron [None req-2a181450-c4a6-48d4-89e5-56ffb15e8492 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] validate_networks() for [('9bf85ef7-1c92-4e5f-a5b9-fcad7da95bf2', None, None, None, None, None)] {{(pid=117684) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 11:21:55.125560 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-2a181450-c4a6-48d4-89e5-56ffb15e8492 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Flavor limits 0:0:0 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 11:21:55.125976 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-2a181450-c4a6-48d4-89e5-56ffb15e8492 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Image limits 0:0:0 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 11:21:55.126438 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-2a181450-c4a6-48d4-89e5-56ffb15e8492 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Flavor pref 0:0:0 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 11:21:55.126819 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-2a181450-c4a6-48d4-89e5-56ffb15e8492 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Image pref 0:0:0 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 11:21:55.127218 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-2a181450-c4a6-48d4-89e5-56ffb15e8492 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 11:21:55.136584 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2a181450-c4a6-48d4-89e5-56ffb15e8492 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:55.137050 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2a181450-c4a6-48d4-89e5-56ffb15e8492 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:55.137472 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2a181450-c4a6-48d4-89e5-56ffb15e8492 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:55.138177 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2a181450-c4a6-48d4-89e5-56ffb15e8492 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:55.138586 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2a181450-c4a6-48d4-89e5-56ffb15e8492 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:55.139001 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2a181450-c4a6-48d4-89e5-56ffb15e8492 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:55.157680 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.quota [None req-2a181450-c4a6-48d4-89e5-56ffb15e8492 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Getting quotas for project cba1dd0b689b4fff847b6fd3787b143c. Resources: {'cores', 'instances', 'ram'} {{(pid=117684) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:21:55.161188 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.quota [None req-2a181450-c4a6-48d4-89e5-56ffb15e8492 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Getting quotas for user f4da6dd860bb45d1a703a18c2512ffe4 and project cba1dd0b689b4fff847b6fd3787b143c. Resources: {'cores', 'instances', 'ram'} {{(pid=117684) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:21:55.171999 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-2a181450-c4a6-48d4-89e5-56ffb15e8492 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Going to run 1 instances... {{(pid=117684) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 11:21:55.174157 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-2a181450-c4a6-48d4-89e5-56ffb15e8492 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: c883c714-443c-4df9-aaa0-8e7e81764fc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2321e9a0-fe0f-47fd-9c4b-8868eb5a00af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117684) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 11:21:55.227793 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-2a181450-c4a6-48d4-89e5-56ffb15e8492 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.630267 Aug 09 11:21:55.228573 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 300/636] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 9 11:21:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 11:21:55.239539 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-948594a5-80d9-408f-89ff-d678599f7441 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:55.240292 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-948594a5-80d9-408f-89ff-d678599f7441 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: c883c714-443c-4df9-aaa0-8e7e81764fc2] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:55.273329 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-c19e068e-b6e7-4ea0-a0ea-e7d6a26491c2 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:55.274131 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-c19e068e-b6e7-4ea0-a0ea-e7d6a26491c2 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:55.283941 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c19e068e-b6e7-4ea0-a0ea-e7d6a26491c2 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:55.284462 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c19e068e-b6e7-4ea0-a0ea-e7d6a26491c2 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:55.284896 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c19e068e-b6e7-4ea0-a0ea-e7d6a26491c2 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:55.285594 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c19e068e-b6e7-4ea0-a0ea-e7d6a26491c2 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:55.286227 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c19e068e-b6e7-4ea0-a0ea-e7d6a26491c2 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:55.286648 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c19e068e-b6e7-4ea0-a0ea-e7d6a26491c2 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:55.301562 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-948594a5-80d9-408f-89ff-d678599f7441 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:55.309312 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-948594a5-80d9-408f-89ff-d678599f7441 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2" status: 200 len: 1241 microversion: 2.1 time: 0.073140 Aug 09 11:21:55.312368 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 337/637] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:55 2022] GET /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2 => generated 1241 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:55.434499 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-c19e068e-b6e7-4ea0-a0ea-e7d6a26491c2 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:55.442338 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-c19e068e-b6e7-4ea0-a0ea-e7d6a26491c2 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1663 microversion: 2.1 time: 0.173219 Aug 09 11:21:55.442908 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 301/638] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:55 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1663 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:55.632206 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-51d2d3a1-88f9-4c65-85da-fae82664766b tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:55.633213 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-51d2d3a1-88f9-4c65-85da-fae82664766b tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:55.639657 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-51d2d3a1-88f9-4c65-85da-fae82664766b tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:55.640145 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-51d2d3a1-88f9-4c65-85da-fae82664766b tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:55.640604 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-51d2d3a1-88f9-4c65-85da-fae82664766b tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:55.641297 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-51d2d3a1-88f9-4c65-85da-fae82664766b tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:55.641745 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-51d2d3a1-88f9-4c65-85da-fae82664766b tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:55.642160 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-51d2d3a1-88f9-4c65-85da-fae82664766b tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:55.674982 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-e6fbb35c-dab0-4903-8384-899fc3d2ee24 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:55.675588 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-e6fbb35c-dab0-4903-8384-899fc3d2ee24 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] [instance: b53460e2-2036-40d3-acfc-46ad41e98836] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:55.681941 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e6fbb35c-dab0-4903-8384-899fc3d2ee24 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:55.682493 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e6fbb35c-dab0-4903-8384-899fc3d2ee24 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:55.683087 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e6fbb35c-dab0-4903-8384-899fc3d2ee24 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:55.683820 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e6fbb35c-dab0-4903-8384-899fc3d2ee24 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:55.684247 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e6fbb35c-dab0-4903-8384-899fc3d2ee24 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:55.684878 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e6fbb35c-dab0-4903-8384-899fc3d2ee24 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:55.840643 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-51d2d3a1-88f9-4c65-85da-fae82664766b tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:55.848621 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-51d2d3a1-88f9-4c65-85da-fae82664766b tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078" status: 200 len: 1369 microversion: 2.1 time: 0.220093 Aug 09 11:21:55.849520 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 338/639] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:55 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 => generated 1369 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:55.872157 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-e6fbb35c-dab0-4903-8384-899fc3d2ee24 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff3135cc1482461caf69068b659f49e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2f6acb3c3a4b24be797a677d868227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:55.879736 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-e6fbb35c-dab0-4903-8384-899fc3d2ee24 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] 10.222.0.27 "GET /compute/v2.1/servers/b53460e2-2036-40d3-acfc-46ad41e98836" status: 200 len: 1319 microversion: 2.1 time: 0.208626 Aug 09 11:21:55.880332 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 302/640] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:55 2022] GET /compute/v2.1/servers/b53460e2-2036-40d3-acfc-46ad41e98836 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:56.333734 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-d2552618-2f33-41e5-939b-6461a5d67170 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:56.334337 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-d2552618-2f33-41e5-939b-6461a5d67170 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: c883c714-443c-4df9-aaa0-8e7e81764fc2] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:56.341642 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d2552618-2f33-41e5-939b-6461a5d67170 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:56.342128 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d2552618-2f33-41e5-939b-6461a5d67170 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:56.342562 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d2552618-2f33-41e5-939b-6461a5d67170 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:56.343256 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d2552618-2f33-41e5-939b-6461a5d67170 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:56.343705 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d2552618-2f33-41e5-939b-6461a5d67170 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:56.344116 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d2552618-2f33-41e5-939b-6461a5d67170 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:56.410247 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-d2552618-2f33-41e5-939b-6461a5d67170 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:56.418226 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-d2552618-2f33-41e5-939b-6461a5d67170 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2" status: 200 len: 1245 microversion: 2.1 time: 0.088677 Aug 09 11:21:56.418815 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 339/641] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:56 2022] GET /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2 => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:56.463202 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-cc48b931-88ab-4480-a8b4-d361a36e5d57 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:56.464074 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-cc48b931-88ab-4480-a8b4-d361a36e5d57 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:56.471279 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cc48b931-88ab-4480-a8b4-d361a36e5d57 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:56.471786 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cc48b931-88ab-4480-a8b4-d361a36e5d57 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:56.472213 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cc48b931-88ab-4480-a8b4-d361a36e5d57 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:56.472933 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cc48b931-88ab-4480-a8b4-d361a36e5d57 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:56.473379 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cc48b931-88ab-4480-a8b4-d361a36e5d57 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:56.473789 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cc48b931-88ab-4480-a8b4-d361a36e5d57 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:56.614575 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-cc48b931-88ab-4480-a8b4-d361a36e5d57 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:56.622745 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-cc48b931-88ab-4480-a8b4-d361a36e5d57 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1667 microversion: 2.1 time: 0.163399 Aug 09 11:21:56.623343 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 303/642] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:56 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1667 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:56.874338 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-cc2c6390-2e80-4de6-9dda-ece635878749 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:56.875335 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-cc2c6390-2e80-4de6-9dda-ece635878749 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:56.885531 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-cc2c6390-2e80-4de6-9dda-ece635878749 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:56.886611 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-cc2c6390-2e80-4de6-9dda-ece635878749 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:56.887044 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-cc2c6390-2e80-4de6-9dda-ece635878749 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:56.887735 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-cc2c6390-2e80-4de6-9dda-ece635878749 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:56.888184 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-cc2c6390-2e80-4de6-9dda-ece635878749 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:56.888642 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-cc2c6390-2e80-4de6-9dda-ece635878749 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:56.899981 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-9175914a-cf33-403c-a91b-62a9458fd866 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:56.900615 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-9175914a-cf33-403c-a91b-62a9458fd866 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] [instance: b53460e2-2036-40d3-acfc-46ad41e98836] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:56.907525 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9175914a-cf33-403c-a91b-62a9458fd866 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:56.908014 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9175914a-cf33-403c-a91b-62a9458fd866 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:56.908469 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9175914a-cf33-403c-a91b-62a9458fd866 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:56.909245 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9175914a-cf33-403c-a91b-62a9458fd866 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:56.909694 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9175914a-cf33-403c-a91b-62a9458fd866 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:56.910124 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9175914a-cf33-403c-a91b-62a9458fd866 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:57.075130 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-cc2c6390-2e80-4de6-9dda-ece635878749 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:57.084210 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-cc2c6390-2e80-4de6-9dda-ece635878749 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078" status: 200 len: 1563 microversion: 2.1 time: 0.216490 Aug 09 11:21:57.100541 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-9175914a-cf33-403c-a91b-62a9458fd866 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff3135cc1482461caf69068b659f49e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2f6acb3c3a4b24be797a677d868227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:57.100838 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 340/643] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:56 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 => generated 1563 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:57.106001 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-3b20e0a6-0d5a-4a0e-82ca-e90ffaf304cc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:57.106708 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-3b20e0a6-0d5a-4a0e-82ca-e90ffaf304cc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:57.110275 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-9175914a-cf33-403c-a91b-62a9458fd866 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] 10.222.0.27 "GET /compute/v2.1/servers/b53460e2-2036-40d3-acfc-46ad41e98836" status: 200 len: 1319 microversion: 2.1 time: 0.213894 Aug 09 11:21:57.121310 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 304/644] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:56 2022] GET /compute/v2.1/servers/b53460e2-2036-40d3-acfc-46ad41e98836 => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:57.125730 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3b20e0a6-0d5a-4a0e-82ca-e90ffaf304cc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:57.126161 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3b20e0a6-0d5a-4a0e-82ca-e90ffaf304cc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:57.126830 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3b20e0a6-0d5a-4a0e-82ca-e90ffaf304cc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:57.127545 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3b20e0a6-0d5a-4a0e-82ca-e90ffaf304cc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:57.128002 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3b20e0a6-0d5a-4a0e-82ca-e90ffaf304cc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:57.128440 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3b20e0a6-0d5a-4a0e-82ca-e90ffaf304cc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:57.251927 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-3b20e0a6-0d5a-4a0e-82ca-e90ffaf304cc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.149848 Aug 09 11:21:57.252576 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 341/645] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Aug 9 11:21:57 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078/os-interface => generated 285 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:21:57.329986 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [req-99c5d5b1-57c8-462d-82f0-c761f8c80d50 req-cd8a4120-5f1a-4e80-8f8e-ef34880fa1d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b53460e2-2036-40d3-acfc-46ad41e98836", "name": "network-vif-plugged", "status": "completed", "tag": "698bd695-580e-4f6d-8280-7cdeba7f5874"}]} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:21:57.341578 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-99c5d5b1-57c8-462d-82f0-c761f8c80d50 req-cd8a4120-5f1a-4e80-8f8e-ef34880fa1d1 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:57.342331 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-99c5d5b1-57c8-462d-82f0-c761f8c80d50 req-cd8a4120-5f1a-4e80-8f8e-ef34880fa1d1 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:57.342809 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-99c5d5b1-57c8-462d-82f0-c761f8c80d50 req-cd8a4120-5f1a-4e80-8f8e-ef34880fa1d1 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:57.357983 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.compute.server_external_events [req-99c5d5b1-57c8-462d-82f0-c761f8c80d50 req-cd8a4120-5f1a-4e80-8f8e-ef34880fa1d1 service nova] Creating event network-vif-plugged:698bd695-580e-4f6d-8280-7cdeba7f5874 for instance b53460e2-2036-40d3-acfc-46ad41e98836 on hv-cinder-85251 Aug 09 11:21:57.366828 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [req-99c5d5b1-57c8-462d-82f0-c761f8c80d50 req-cd8a4120-5f1a-4e80-8f8e-ef34880fa1d1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040380 Aug 09 11:21:57.367945 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 305/646] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:21:57.439521 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-5d2867c3-6cef-4a76-b221-196e5caee104 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:57.440129 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-5d2867c3-6cef-4a76-b221-196e5caee104 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: c883c714-443c-4df9-aaa0-8e7e81764fc2] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:57.446020 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5d2867c3-6cef-4a76-b221-196e5caee104 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:57.446494 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5d2867c3-6cef-4a76-b221-196e5caee104 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:57.446921 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5d2867c3-6cef-4a76-b221-196e5caee104 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:57.447601 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5d2867c3-6cef-4a76-b221-196e5caee104 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:57.448108 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5d2867c3-6cef-4a76-b221-196e5caee104 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:57.448556 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5d2867c3-6cef-4a76-b221-196e5caee104 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:57.532077 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-5d2867c3-6cef-4a76-b221-196e5caee104 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:57.540877 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-5d2867c3-6cef-4a76-b221-196e5caee104 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2" status: 200 len: 1299 microversion: 2.1 time: 0.105874 Aug 09 11:21:57.542282 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 342/647] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:57 2022] GET /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2 => generated 1299 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:58.133391 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-7b2bdb2e-eb8d-447e-b680-753051f2d127 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:58.134744 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-7b2bdb2e-eb8d-447e-b680-753051f2d127 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] [instance: b53460e2-2036-40d3-acfc-46ad41e98836] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:58.142267 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7b2bdb2e-eb8d-447e-b680-753051f2d127 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:58.142757 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7b2bdb2e-eb8d-447e-b680-753051f2d127 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:58.143543 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7b2bdb2e-eb8d-447e-b680-753051f2d127 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:58.144251 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7b2bdb2e-eb8d-447e-b680-753051f2d127 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:58.144728 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7b2bdb2e-eb8d-447e-b680-753051f2d127 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:58.145151 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7b2bdb2e-eb8d-447e-b680-753051f2d127 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:58.149716 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell1:SELECT=100 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:21:58.344694 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-ea2b6b04-3a25-4ce6-ba24-b35cec0c06fd req-28db2946-50e2-4df9-af84-af2d5bacb05c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8009a1a2-4c8e-4953-ba5c-faab2db05078", "tag": "13fa53bd-98eb-4624-884c-1b14e8d98ae7"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:21:58.354694 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-ea2b6b04-3a25-4ce6-ba24-b35cec0c06fd req-28db2946-50e2-4df9-af84-af2d5bacb05c service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:58.355520 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-ea2b6b04-3a25-4ce6-ba24-b35cec0c06fd req-28db2946-50e2-4df9-af84-af2d5bacb05c service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:58.355520 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-ea2b6b04-3a25-4ce6-ba24-b35cec0c06fd req-28db2946-50e2-4df9-af84-af2d5bacb05c service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:58.367718 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-ea2b6b04-3a25-4ce6-ba24-b35cec0c06fd req-28db2946-50e2-4df9-af84-af2d5bacb05c service nova] Creating event network-changed:13fa53bd-98eb-4624-884c-1b14e8d98ae7 for instance 8009a1a2-4c8e-4953-ba5c-faab2db05078 on hv-cinder-85251 Aug 09 11:21:58.373694 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-ea2b6b04-3a25-4ce6-ba24-b35cec0c06fd req-28db2946-50e2-4df9-af84-af2d5bacb05c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032866 Aug 09 11:21:58.374779 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 343/648] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:21:58.429305 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-7b2bdb2e-eb8d-447e-b680-753051f2d127 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff3135cc1482461caf69068b659f49e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2f6acb3c3a4b24be797a677d868227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:58.437899 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-7b2bdb2e-eb8d-447e-b680-753051f2d127 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] 10.222.0.27 "GET /compute/v2.1/servers/b53460e2-2036-40d3-acfc-46ad41e98836" status: 200 len: 1319 microversion: 2.1 time: 0.308811 Aug 09 11:21:58.438464 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 306/649] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:58 2022] GET /compute/v2.1/servers/b53460e2-2036-40d3-acfc-46ad41e98836 => generated 1319 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:58.565620 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-9878aaec-f48c-401b-8814-7c7aca532146 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:58.566549 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-9878aaec-f48c-401b-8814-7c7aca532146 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: c883c714-443c-4df9-aaa0-8e7e81764fc2] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:58.573247 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9878aaec-f48c-401b-8814-7c7aca532146 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:58.573712 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9878aaec-f48c-401b-8814-7c7aca532146 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:58.574398 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9878aaec-f48c-401b-8814-7c7aca532146 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:58.575113 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9878aaec-f48c-401b-8814-7c7aca532146 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:58.575586 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9878aaec-f48c-401b-8814-7c7aca532146 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:58.576026 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9878aaec-f48c-401b-8814-7c7aca532146 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:58.888977 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-9878aaec-f48c-401b-8814-7c7aca532146 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:58.900799 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-9878aaec-f48c-401b-8814-7c7aca532146 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2" status: 200 len: 1367 microversion: 2.1 time: 0.340722 Aug 09 11:21:58.915071 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 344/650] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:58 2022] GET /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2 => generated 1367 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:59.119423 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [req-9951454c-3b15-40ff-ae5d-447ee027d9b9 req-c5cb2896-bc15-42c8-b8a1-6dbb8ca6a1fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c883c714-443c-4df9-aaa0-8e7e81764fc2", "tag": "266ca4c8-2fb3-4c5b-b9a9-6457541c0746"}]} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:21:59.129359 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-9951454c-3b15-40ff-ae5d-447ee027d9b9 req-c5cb2896-bc15-42c8-b8a1-6dbb8ca6a1fd service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:59.130000 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-9951454c-3b15-40ff-ae5d-447ee027d9b9 req-c5cb2896-bc15-42c8-b8a1-6dbb8ca6a1fd service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:59.130486 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-9951454c-3b15-40ff-ae5d-447ee027d9b9 req-c5cb2896-bc15-42c8-b8a1-6dbb8ca6a1fd service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:59.144149 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.compute.server_external_events [req-9951454c-3b15-40ff-ae5d-447ee027d9b9 req-c5cb2896-bc15-42c8-b8a1-6dbb8ca6a1fd service nova] Creating event network-changed:266ca4c8-2fb3-4c5b-b9a9-6457541c0746 for instance c883c714-443c-4df9-aaa0-8e7e81764fc2 on hv-cinder-85251 Aug 09 11:21:59.149078 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [req-9951454c-3b15-40ff-ae5d-447ee027d9b9 req-c5cb2896-bc15-42c8-b8a1-6dbb8ca6a1fd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034298 Aug 09 11:21:59.149752 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 307/651] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:21:59.458432 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-da169346-fd4f-4c49-b37c-2106a730a45e tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:59.459017 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-da169346-fd4f-4c49-b37c-2106a730a45e tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] [instance: b53460e2-2036-40d3-acfc-46ad41e98836] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:59.465447 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-da169346-fd4f-4c49-b37c-2106a730a45e tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:59.465934 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-da169346-fd4f-4c49-b37c-2106a730a45e tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:59.466367 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-da169346-fd4f-4c49-b37c-2106a730a45e tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:59.467067 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-da169346-fd4f-4c49-b37c-2106a730a45e tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:59.467516 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-da169346-fd4f-4c49-b37c-2106a730a45e tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:59.467943 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-da169346-fd4f-4c49-b37c-2106a730a45e tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:59.601848 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-da169346-fd4f-4c49-b37c-2106a730a45e tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff3135cc1482461caf69068b659f49e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2f6acb3c3a4b24be797a677d868227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:21:59.609840 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-da169346-fd4f-4c49-b37c-2106a730a45e tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] 10.222.0.27 "GET /compute/v2.1/servers/b53460e2-2036-40d3-acfc-46ad41e98836" status: 200 len: 1508 microversion: 2.1 time: 0.155406 Aug 09 11:21:59.610414 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 345/652] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:59 2022] GET /compute/v2.1/servers/b53460e2-2036-40d3-acfc-46ad41e98836 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:21:59.636448 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-e35ef7f2-3b01-4a1b-846f-371f204291c8 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55fd27a2-f6b2-4869-9936-77776d0429a1", "device": "/dev/sdb"}} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:21:59.639354 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-e35ef7f2-3b01-4a1b-846f-371f204291c8 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] [instance: b53460e2-2036-40d3-acfc-46ad41e98836] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:59.646000 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e35ef7f2-3b01-4a1b-846f-371f204291c8 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:59.646471 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e35ef7f2-3b01-4a1b-846f-371f204291c8 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:59.646893 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e35ef7f2-3b01-4a1b-846f-371f204291c8 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:59.647567 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e35ef7f2-3b01-4a1b-846f-371f204291c8 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:59.648010 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e35ef7f2-3b01-4a1b-846f-371f204291c8 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:59.648458 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e35ef7f2-3b01-4a1b-846f-371f204291c8 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:59.922780 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-4981c0c0-f5c4-4313-9d18-904bf3c0f19d tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:21:59.923393 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-4981c0c0-f5c4-4313-9d18-904bf3c0f19d tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: c883c714-443c-4df9-aaa0-8e7e81764fc2] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:21:59.930059 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4981c0c0-f5c4-4313-9d18-904bf3c0f19d tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:59.930864 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4981c0c0-f5c4-4313-9d18-904bf3c0f19d tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:59.931640 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4981c0c0-f5c4-4313-9d18-904bf3c0f19d tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:21:59.932944 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4981c0c0-f5c4-4313-9d18-904bf3c0f19d tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:21:59.933609 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4981c0c0-f5c4-4313-9d18-904bf3c0f19d tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:21:59.934268 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4981c0c0-f5c4-4313-9d18-904bf3c0f19d tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:00.073607 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-e35ef7f2-3b01-4a1b-846f-371f204291c8 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] 10.222.0.27 "POST /compute/v2.1/servers/b53460e2-2036-40d3-acfc-46ad41e98836/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.443854 Aug 09 11:22:00.075567 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 308/653] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Aug 9 11:21:59 2022] POST /compute/v2.1/servers/b53460e2-2036-40d3-acfc-46ad41e98836/os-volume_attachments => generated 194 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:22:00.214278 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-4981c0c0-f5c4-4313-9d18-904bf3c0f19d tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:00.222000 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-4981c0c0-f5c4-4313-9d18-904bf3c0f19d tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2" status: 200 len: 1367 microversion: 2.1 time: 0.303296 Aug 09 11:22:00.222584 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 346/654] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:21:59 2022] GET /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2 => generated 1367 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:22:01.244252 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-422716ad-38ad-4a69-aefe-8c89cefa507f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:22:01.245020 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-422716ad-38ad-4a69-aefe-8c89cefa507f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: c883c714-443c-4df9-aaa0-8e7e81764fc2] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:22:01.253742 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-422716ad-38ad-4a69-aefe-8c89cefa507f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:01.254323 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-422716ad-38ad-4a69-aefe-8c89cefa507f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:01.254980 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-422716ad-38ad-4a69-aefe-8c89cefa507f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:01.256014 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-422716ad-38ad-4a69-aefe-8c89cefa507f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:01.256595 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-422716ad-38ad-4a69-aefe-8c89cefa507f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:01.257107 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-422716ad-38ad-4a69-aefe-8c89cefa507f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:01.395990 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-422716ad-38ad-4a69-aefe-8c89cefa507f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:01.407215 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-422716ad-38ad-4a69-aefe-8c89cefa507f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2" status: 200 len: 1367 microversion: 2.1 time: 0.167137 Aug 09 11:22:01.407972 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 309/655] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:22:01 2022] GET /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:22:02.434883 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-6ee6364e-a9fe-46db-818a-5e96e79253f1 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:22:02.435446 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-6ee6364e-a9fe-46db-818a-5e96e79253f1 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: c883c714-443c-4df9-aaa0-8e7e81764fc2] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:22:02.442705 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6ee6364e-a9fe-46db-818a-5e96e79253f1 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:02.443203 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6ee6364e-a9fe-46db-818a-5e96e79253f1 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:02.443643 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6ee6364e-a9fe-46db-818a-5e96e79253f1 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:02.444389 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6ee6364e-a9fe-46db-818a-5e96e79253f1 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:02.444842 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6ee6364e-a9fe-46db-818a-5e96e79253f1 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:02.445289 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6ee6364e-a9fe-46db-818a-5e96e79253f1 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:02.582918 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-6ee6364e-a9fe-46db-818a-5e96e79253f1 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:02.590893 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-6ee6364e-a9fe-46db-818a-5e96e79253f1 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2" status: 200 len: 1367 microversion: 2.1 time: 0.161636 Aug 09 11:22:02.591467 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 347/656] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:22:02 2022] GET /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:22:03.614018 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-39528b46-952d-4100-a611-bfa5ad6e5014 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:22:03.614619 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-39528b46-952d-4100-a611-bfa5ad6e5014 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: c883c714-443c-4df9-aaa0-8e7e81764fc2] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:22:03.623796 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-39528b46-952d-4100-a611-bfa5ad6e5014 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:03.624249 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-39528b46-952d-4100-a611-bfa5ad6e5014 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:03.624865 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-39528b46-952d-4100-a611-bfa5ad6e5014 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:03.625800 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-39528b46-952d-4100-a611-bfa5ad6e5014 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:03.626322 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-39528b46-952d-4100-a611-bfa5ad6e5014 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:03.626826 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-39528b46-952d-4100-a611-bfa5ad6e5014 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:03.760346 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-39528b46-952d-4100-a611-bfa5ad6e5014 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:03.773870 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-39528b46-952d-4100-a611-bfa5ad6e5014 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2" status: 200 len: 1367 microversion: 2.1 time: 0.165622 Aug 09 11:22:03.774574 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 310/657] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:22:03 2022] GET /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:22:04.795280 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-a4890aa4-37c9-4775-9498-b653c2f6f214 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:22:04.795851 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-a4890aa4-37c9-4775-9498-b653c2f6f214 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: c883c714-443c-4df9-aaa0-8e7e81764fc2] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:22:04.802951 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a4890aa4-37c9-4775-9498-b653c2f6f214 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:04.803437 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a4890aa4-37c9-4775-9498-b653c2f6f214 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:04.803872 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a4890aa4-37c9-4775-9498-b653c2f6f214 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:04.804607 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a4890aa4-37c9-4775-9498-b653c2f6f214 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:04.805061 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a4890aa4-37c9-4775-9498-b653c2f6f214 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:04.805512 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a4890aa4-37c9-4775-9498-b653c2f6f214 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:04.809856 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:22:04.942395 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-a4890aa4-37c9-4775-9498-b653c2f6f214 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:04.950011 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-a4890aa4-37c9-4775-9498-b653c2f6f214 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2" status: 200 len: 1367 microversion: 2.1 time: 0.158661 Aug 09 11:22:04.950559 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 348/658] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:22:04 2022] GET /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:22:05.339169 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [req-6554656b-abd2-4ee6-8195-55a3303c848c req-ff11e2c9-c842-4555-9760-a37dc6574113 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c883c714-443c-4df9-aaa0-8e7e81764fc2", "name": "network-vif-plugged", "status": "completed", "tag": "266ca4c8-2fb3-4c5b-b9a9-6457541c0746"}]} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:22:05.344988 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell0:SELECT=4 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:22:05.345852 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell0:SELECT=24 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:22:05.352798 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-6554656b-abd2-4ee6-8195-55a3303c848c req-ff11e2c9-c842-4555-9760-a37dc6574113 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:05.353453 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-6554656b-abd2-4ee6-8195-55a3303c848c req-ff11e2c9-c842-4555-9760-a37dc6574113 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:05.354284 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-6554656b-abd2-4ee6-8195-55a3303c848c req-ff11e2c9-c842-4555-9760-a37dc6574113 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:05.367313 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.compute.server_external_events [req-6554656b-abd2-4ee6-8195-55a3303c848c req-ff11e2c9-c842-4555-9760-a37dc6574113 service nova] Creating event network-vif-plugged:266ca4c8-2fb3-4c5b-b9a9-6457541c0746 for instance c883c714-443c-4df9-aaa0-8e7e81764fc2 on hv-cinder-85251 Aug 09 11:22:05.372751 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [req-6554656b-abd2-4ee6-8195-55a3303c848c req-ff11e2c9-c842-4555-9760-a37dc6574113 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037617 Aug 09 11:22:05.373396 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 311/659] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:22:05.972413 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-8b1c70e0-7263-4a99-bbaa-310e4c1eb669 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:22:05.973005 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-8b1c70e0-7263-4a99-bbaa-310e4c1eb669 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: c883c714-443c-4df9-aaa0-8e7e81764fc2] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:22:05.975134 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell0:SELECT=2 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:22:05.982260 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8b1c70e0-7263-4a99-bbaa-310e4c1eb669 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:05.982823 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8b1c70e0-7263-4a99-bbaa-310e4c1eb669 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:05.983334 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8b1c70e0-7263-4a99-bbaa-310e4c1eb669 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:05.984150 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8b1c70e0-7263-4a99-bbaa-310e4c1eb669 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:05.984797 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8b1c70e0-7263-4a99-bbaa-310e4c1eb669 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:05.985294 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8b1c70e0-7263-4a99-bbaa-310e4c1eb669 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:06.121068 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-8b1c70e0-7263-4a99-bbaa-310e4c1eb669 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:06.129232 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-8b1c70e0-7263-4a99-bbaa-310e4c1eb669 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2" status: 200 len: 1367 microversion: 2.1 time: 0.161587 Aug 09 11:22:06.129811 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 349/660] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:22:05 2022] GET /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:22:07.154433 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-8c9e2d1e-4552-4fd9-bf14-4582c7dfdd1a tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:22:07.155488 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-8c9e2d1e-4552-4fd9-bf14-4582c7dfdd1a tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: c883c714-443c-4df9-aaa0-8e7e81764fc2] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:22:07.164379 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8c9e2d1e-4552-4fd9-bf14-4582c7dfdd1a tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:07.165071 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8c9e2d1e-4552-4fd9-bf14-4582c7dfdd1a tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:07.165651 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8c9e2d1e-4552-4fd9-bf14-4582c7dfdd1a tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:07.166586 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8c9e2d1e-4552-4fd9-bf14-4582c7dfdd1a tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:07.167203 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8c9e2d1e-4552-4fd9-bf14-4582c7dfdd1a tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:07.167781 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8c9e2d1e-4552-4fd9-bf14-4582c7dfdd1a tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:07.311598 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-8c9e2d1e-4552-4fd9-bf14-4582c7dfdd1a tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:07.319808 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-8c9e2d1e-4552-4fd9-bf14-4582c7dfdd1a tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2" status: 200 len: 1367 microversion: 2.1 time: 0.172127 Aug 09 11:22:07.320369 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 312/661] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:22:07 2022] GET /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:22:08.345402 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-8b262f66-59e4-4d0f-8ce9-94c203c16906 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:22:08.346002 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-8b262f66-59e4-4d0f-8ce9-94c203c16906 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: c883c714-443c-4df9-aaa0-8e7e81764fc2] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:22:08.352468 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8b262f66-59e4-4d0f-8ce9-94c203c16906 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:08.352948 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8b262f66-59e4-4d0f-8ce9-94c203c16906 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:08.353376 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8b262f66-59e4-4d0f-8ce9-94c203c16906 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:08.354054 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8b262f66-59e4-4d0f-8ce9-94c203c16906 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:08.354489 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8b262f66-59e4-4d0f-8ce9-94c203c16906 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:08.354902 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8b262f66-59e4-4d0f-8ce9-94c203c16906 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:08.504538 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-8b262f66-59e4-4d0f-8ce9-94c203c16906 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:08.517222 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-8b262f66-59e4-4d0f-8ce9-94c203c16906 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2" status: 200 len: 1557 microversion: 2.1 time: 0.176960 Aug 09 11:22:08.518034 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 350/662] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:22:08 2022] GET /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2 => generated 1557 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:22:08.542083 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-cc814f3d-c936-48fe-9c32-c1f0ecf2556a tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:22:08.542644 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-cc814f3d-c936-48fe-9c32-c1f0ecf2556a tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: c883c714-443c-4df9-aaa0-8e7e81764fc2] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:22:08.549486 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cc814f3d-c936-48fe-9c32-c1f0ecf2556a tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:08.549959 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cc814f3d-c936-48fe-9c32-c1f0ecf2556a tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:08.550385 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cc814f3d-c936-48fe-9c32-c1f0ecf2556a tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:08.551071 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cc814f3d-c936-48fe-9c32-c1f0ecf2556a tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:08.551505 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cc814f3d-c936-48fe-9c32-c1f0ecf2556a tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:08.551919 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cc814f3d-c936-48fe-9c32-c1f0ecf2556a tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:08.638695 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-cc814f3d-c936-48fe-9c32-c1f0ecf2556a tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100390 Aug 09 11:22:08.639327 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 313/663] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Aug 9 11:22:08 2022] GET /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:22:09.633166 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-48abe387-19c6-4dcb-89ea-a605bef9c33a req-5db55171-cf0e-4190-8e39-107bcae57285 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c883c714-443c-4df9-aaa0-8e7e81764fc2", "tag": "266ca4c8-2fb3-4c5b-b9a9-6457541c0746"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:22:09.643987 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-48abe387-19c6-4dcb-89ea-a605bef9c33a req-5db55171-cf0e-4190-8e39-107bcae57285 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:09.644600 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-48abe387-19c6-4dcb-89ea-a605bef9c33a req-5db55171-cf0e-4190-8e39-107bcae57285 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:09.645025 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-48abe387-19c6-4dcb-89ea-a605bef9c33a req-5db55171-cf0e-4190-8e39-107bcae57285 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:09.656658 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-48abe387-19c6-4dcb-89ea-a605bef9c33a req-5db55171-cf0e-4190-8e39-107bcae57285 service nova] Creating event network-changed:266ca4c8-2fb3-4c5b-b9a9-6457541c0746 for instance c883c714-443c-4df9-aaa0-8e7e81764fc2 on hv-cinder-85251 Aug 09 11:22:09.661770 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-48abe387-19c6-4dcb-89ea-a605bef9c33a req-5db55171-cf0e-4190-8e39-107bcae57285 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032288 Aug 09 11:22:09.662638 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 351/664] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:22:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:22:20.851550 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:22:20.852303 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:22:20.856997 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-4cca41bd-4b77-4c9d-9c1a-816eb214e8b5 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:22:20.857481 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-4cca41bd-4b77-4c9d-9c1a-816eb214e8b5 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] [instance: b53460e2-2036-40d3-acfc-46ad41e98836] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:22:20.866279 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4cca41bd-4b77-4c9d-9c1a-816eb214e8b5 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:20.866761 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4cca41bd-4b77-4c9d-9c1a-816eb214e8b5 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:20.867188 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4cca41bd-4b77-4c9d-9c1a-816eb214e8b5 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:20.868931 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4cca41bd-4b77-4c9d-9c1a-816eb214e8b5 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:20.869487 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4cca41bd-4b77-4c9d-9c1a-816eb214e8b5 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:20.869905 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4cca41bd-4b77-4c9d-9c1a-816eb214e8b5 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:20.967904 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.objects.instance [None req-4cca41bd-4b77-4c9d-9c1a-816eb214e8b5 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lazy-loading 'services' on Instance uuid b53460e2-2036-40d3-acfc-46ad41e98836 {{(pid=117684) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:22:21.069718 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-4cca41bd-4b77-4c9d-9c1a-816eb214e8b5 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b53460e2-2036-40d3-acfc-46ad41e98836/os-volume_attachments/55fd27a2-f6b2-4869-9936-77776d0429a1" status: 202 len: 0 microversion: 2.1 time: 0.220075 Aug 09 11:22:21.071373 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 314/665] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Aug 9 11:22:20 2022] DELETE /compute/v2.1/servers/b53460e2-2036-40d3-acfc-46ad41e98836/os-volume_attachments/55fd27a2-f6b2-4869-9936-77776d0429a1 => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:22:22.194311 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-4981724d-1070-41a3-899e-2dc61335c20b tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:22:22.194887 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-4981724d-1070-41a3-899e-2dc61335c20b tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] [instance: b53460e2-2036-40d3-acfc-46ad41e98836] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:22:22.197528 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_api:SELECT=41 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:22:22.198200 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell1:SELECT=18 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:22:22.204785 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4981724d-1070-41a3-899e-2dc61335c20b tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:22.205340 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4981724d-1070-41a3-899e-2dc61335c20b tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:22.205776 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4981724d-1070-41a3-899e-2dc61335c20b tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:22.206485 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4981724d-1070-41a3-899e-2dc61335c20b tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:22.206928 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4981724d-1070-41a3-899e-2dc61335c20b tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:22.207355 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4981724d-1070-41a3-899e-2dc61335c20b tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:22.232470 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-4981724d-1070-41a3-899e-2dc61335c20b tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] [instance: b53460e2-2036-40d3-acfc-46ad41e98836] Going to try to terminate instance {{(pid=117685) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 11:22:22.315586 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-4981724d-1070-41a3-899e-2dc61335c20b tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b53460e2-2036-40d3-acfc-46ad41e98836" status: 204 len: 0 microversion: 2.1 time: 0.125516 Aug 09 11:22:22.316286 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 352/666] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 9 11:22:22 2022] DELETE /compute/v2.1/servers/b53460e2-2036-40d3-acfc-46ad41e98836 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 11:22:22.325339 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-afa52b9f-6fe8-475c-8baa-ecfdb188124d tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:22:22.326221 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-afa52b9f-6fe8-475c-8baa-ecfdb188124d tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] [instance: b53460e2-2036-40d3-acfc-46ad41e98836] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:22:22.333415 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-afa52b9f-6fe8-475c-8baa-ecfdb188124d tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:22.333824 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-afa52b9f-6fe8-475c-8baa-ecfdb188124d tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:22.334254 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-afa52b9f-6fe8-475c-8baa-ecfdb188124d tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:22.334946 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-afa52b9f-6fe8-475c-8baa-ecfdb188124d tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:22.335396 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-afa52b9f-6fe8-475c-8baa-ecfdb188124d tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:22.335809 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-afa52b9f-6fe8-475c-8baa-ecfdb188124d tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:22.469093 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-afa52b9f-6fe8-475c-8baa-ecfdb188124d tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff3135cc1482461caf69068b659f49e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2f6acb3c3a4b24be797a677d868227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:22.477216 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-afa52b9f-6fe8-475c-8baa-ecfdb188124d tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] 10.222.0.27 "GET /compute/v2.1/servers/b53460e2-2036-40d3-acfc-46ad41e98836" status: 200 len: 1514 microversion: 2.1 time: 0.156264 Aug 09 11:22:22.477820 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 315/667] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:22:22 2022] GET /compute/v2.1/servers/b53460e2-2036-40d3-acfc-46ad41e98836 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:22:23.502889 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-791640e8-628a-4d51-84ab-b4b7749618d7 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:22:23.503688 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-791640e8-628a-4d51-84ab-b4b7749618d7 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] [instance: b53460e2-2036-40d3-acfc-46ad41e98836] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:22:23.511230 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-791640e8-628a-4d51-84ab-b4b7749618d7 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:23.511764 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-791640e8-628a-4d51-84ab-b4b7749618d7 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:23.512233 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-791640e8-628a-4d51-84ab-b4b7749618d7 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:23.513025 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-791640e8-628a-4d51-84ab-b4b7749618d7 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:23.513515 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-791640e8-628a-4d51-84ab-b4b7749618d7 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:23.513975 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-791640e8-628a-4d51-84ab-b4b7749618d7 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:23.659020 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-791640e8-628a-4d51-84ab-b4b7749618d7 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff3135cc1482461caf69068b659f49e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2f6acb3c3a4b24be797a677d868227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:23.667474 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-791640e8-628a-4d51-84ab-b4b7749618d7 tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] 10.222.0.27 "GET /compute/v2.1/servers/b53460e2-2036-40d3-acfc-46ad41e98836" status: 200 len: 1514 microversion: 2.1 time: 0.170616 Aug 09 11:22:23.668020 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 353/668] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:22:23 2022] GET /compute/v2.1/servers/b53460e2-2036-40d3-acfc-46ad41e98836 => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:22:24.690515 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-3f26a0cc-ce05-44a9-b10a-fcbab23e12cc tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:22:24.691102 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-3f26a0cc-ce05-44a9-b10a-fcbab23e12cc tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] [instance: b53460e2-2036-40d3-acfc-46ad41e98836] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:22:24.698445 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3f26a0cc-ce05-44a9-b10a-fcbab23e12cc tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:24.698988 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3f26a0cc-ce05-44a9-b10a-fcbab23e12cc tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:24.699401 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3f26a0cc-ce05-44a9-b10a-fcbab23e12cc tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:24.700099 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3f26a0cc-ce05-44a9-b10a-fcbab23e12cc tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:24.700672 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3f26a0cc-ce05-44a9-b10a-fcbab23e12cc tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:24.701093 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3f26a0cc-ce05-44a9-b10a-fcbab23e12cc tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:24.915496 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-3f26a0cc-ce05-44a9-b10a-fcbab23e12cc tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff3135cc1482461caf69068b659f49e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2f6acb3c3a4b24be797a677d868227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:24.927949 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-3f26a0cc-ce05-44a9-b10a-fcbab23e12cc tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] 10.222.0.27 "GET /compute/v2.1/servers/b53460e2-2036-40d3-acfc-46ad41e98836" status: 200 len: 1514 microversion: 2.1 time: 0.241362 Aug 09 11:22:24.928981 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 316/669] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:22:24 2022] GET /compute/v2.1/servers/b53460e2-2036-40d3-acfc-46ad41e98836 => generated 1514 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:22:25.090704 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-64c4390a-0e61-48ff-94cc-b1e3b2a62c96 req-b174b08a-7260-4e30-aa02-487063f79dc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b53460e2-2036-40d3-acfc-46ad41e98836", "name": "network-vif-deleted", "tag": "698bd695-580e-4f6d-8280-7cdeba7f5874"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:22:25.105399 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-64c4390a-0e61-48ff-94cc-b1e3b2a62c96 req-b174b08a-7260-4e30-aa02-487063f79dc1 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:25.105856 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-64c4390a-0e61-48ff-94cc-b1e3b2a62c96 req-b174b08a-7260-4e30-aa02-487063f79dc1 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:25.106274 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-64c4390a-0e61-48ff-94cc-b1e3b2a62c96 req-b174b08a-7260-4e30-aa02-487063f79dc1 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:25.118962 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-64c4390a-0e61-48ff-94cc-b1e3b2a62c96 req-b174b08a-7260-4e30-aa02-487063f79dc1 service nova] Creating event network-vif-deleted:698bd695-580e-4f6d-8280-7cdeba7f5874 for instance b53460e2-2036-40d3-acfc-46ad41e98836 on hv-cinder-85251 Aug 09 11:22:25.124129 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-64c4390a-0e61-48ff-94cc-b1e3b2a62c96 req-b174b08a-7260-4e30-aa02-487063f79dc1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038215 Aug 09 11:22:25.124764 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 354/670] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:22:25.949737 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-23b0f169-3af1-4309-805f-8200d44367ed tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:22:25.950361 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-23b0f169-3af1-4309-805f-8200d44367ed tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] [instance: b53460e2-2036-40d3-acfc-46ad41e98836] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:22:25.957379 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-23b0f169-3af1-4309-805f-8200d44367ed tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:25.957878 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-23b0f169-3af1-4309-805f-8200d44367ed tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:25.958279 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-23b0f169-3af1-4309-805f-8200d44367ed tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:25.958960 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-23b0f169-3af1-4309-805f-8200d44367ed tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:25.959425 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-23b0f169-3af1-4309-805f-8200d44367ed tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:25.959816 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-23b0f169-3af1-4309-805f-8200d44367ed tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:25.973627 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.wsgi [None req-23b0f169-3af1-4309-805f-8200d44367ed tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] HTTP exception thrown: Instance b53460e2-2036-40d3-acfc-46ad41e98836 could not be found. Aug 09 11:22:25.975253 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-23b0f169-3af1-4309-805f-8200d44367ed tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Request method failure captured: Aug 09 11:22:25.975253 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: request: GET /compute/v2.1/servers/b53460e2-2036-40d3-acfc-46ad41e98836 HTTP/1.1 Aug 09 11:22:25.975253 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept: application/json Aug 09 11:22:25.975253 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept-Encoding: identity Aug 09 11:22:25.975253 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Connection: close Aug 09 11:22:25.975253 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Length: 0 Aug 09 11:22:25.975253 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Type: application/json Aug 09 11:22:25.975253 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Host: 10.222.0.27 Aug 09 11:22:25.975253 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Openstack-System-Scope: None Aug 09 11:22:25.975253 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: User-Agent: python-urllib3/1.26.11 Aug 09 11:22:25.975253 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Auth-Token: gAAAAABi8kLDGaGqFyHi2tgdJCz0eNCvayv_xUhZWeHkcnFKPYVj2qXfab9rkwpXrmvHm5_m0mIc-9i4T44mlleBVc0-bYdbjzmNoHJiPWiuBH0BNP5IOLosAp-m2LuL2MKWKCQBLFG7jh57bVL5npEA-wp7ZJ0JlrwXIHRJ4oPPv5l6P__KnF4 Aug 09 11:22:25.975253 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Id: None Aug 09 11:22:25.975253 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Name: None Aug 09 11:22:25.975253 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Identity-Status: Confirmed Aug 09 11:22:25.975253 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Is-Admin-Project: True Aug 09 11:22:25.975253 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Id: default Aug 09 11:22:25.975253 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Name: Default Aug 09 11:22:25.975253 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Id: 7a2f6acb3c3a4b24be797a677d868227 Aug 09 11:22:25.975253 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Name: tempest-VolumesSnapshotTestJSON-318962451 Aug 09 11:22:25.975253 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Role: member,reader Aug 09 11:22:25.975253 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Roles: member,reader Aug 09 11:22:25.976741 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a2f6acb3c3a4b24be797a677d868227"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7a2f6acb3c3a4b24be797a677d868227"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7a2f6acb3c3a4b24be797a677d868227"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a2f6acb3c3a4b24be797a677d868227"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:22:25.976741 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant: tempest-VolumesSnapshotTestJSON-318962451 Aug 09 11:22:25.976741 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Id: 7a2f6acb3c3a4b24be797a677d868227 Aug 09 11:22:25.976741 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-318962451 Aug 09 11:22:25.976741 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User: tempest-VolumesSnapshotTestJSON-318962451-project Aug 09 11:22:25.976741 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Id: default Aug 09 11:22:25.976741 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Name: Default Aug 09 11:22:25.976741 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Id: ff3135cc1482461caf69068b659f49e4 Aug 09 11:22:25.976741 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Name: tempest-VolumesSnapshotTestJSON-318962451-project Aug 09 11:22:25.976741 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: method: > Aug 09 11:22:25.976741 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: exception: Instance b53460e2-2036-40d3-acfc-46ad41e98836 could not be found. Aug 09 11:22:25.976741 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: action_args: {'id': 'b53460e2-2036-40d3-acfc-46ad41e98836'} Aug 09 11:22:25.977602 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:22:25.977602 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:22:25.977602 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:22:25.977602 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:22:25.977602 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:22:25.977602 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:22:25.977602 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:22:25.977602 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:22:25.977602 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:22:25.977602 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:22:25.977602 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b53460e2-2036-40d3-acfc-46ad41e98836 could not be found. Aug 09 11:22:25.977602 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:22:25.977602 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:22:25.977602 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:22:25.977602 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:22:25.977602 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:22:25.977602 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:22:25.977602 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:22:25.977602 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:22:25.977602 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:22:25.979157 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:22:25.979157 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:22:25.979157 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:22:25.979157 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:22:25.979157 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:22:25.979157 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:22:25.979157 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:22:25.979157 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b53460e2-2036-40d3-acfc-46ad41e98836 could not be found. Aug 09 11:22:25.979157 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:22:25.979157 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:22:25.979157 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:22:25.979157 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:22:25.979157 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:22:25.979157 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:22:25.979157 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:22:25.979157 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:22:25.979157 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b53460e2-2036-40d3-acfc-46ad41e98836 could not be found. Aug 09 11:22:25.979157 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:22:25.988444 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-23b0f169-3af1-4309-805f-8200d44367ed tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] Returning 404 to user: Instance b53460e2-2036-40d3-acfc-46ad41e98836 could not be found. {{(pid=117684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:22:25.988444 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-23b0f169-3af1-4309-805f-8200d44367ed tempest-VolumesSnapshotTestJSON-318962451 tempest-VolumesSnapshotTestJSON-318962451-project] 10.222.0.27 "GET /compute/v2.1/servers/b53460e2-2036-40d3-acfc-46ad41e98836" status: 404 len: 111 microversion: 2.1 time: 0.030869 Aug 09 11:22:25.988444 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 317/671] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:22:25 2022] GET /compute/v2.1/servers/b53460e2-2036-40d3-acfc-46ad41e98836 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:22:33.135942 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-0551db67-3368-478a-9ce7-f0d1c9860b2d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:22:33.136585 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-0551db67-3368-478a-9ce7-f0d1c9860b2d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:22:33.143339 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0551db67-3368-478a-9ce7-f0d1c9860b2d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:33.143852 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0551db67-3368-478a-9ce7-f0d1c9860b2d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:33.144680 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0551db67-3368-478a-9ce7-f0d1c9860b2d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:33.145391 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0551db67-3368-478a-9ce7-f0d1c9860b2d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:33.145840 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0551db67-3368-478a-9ce7-f0d1c9860b2d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:33.146436 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0551db67-3368-478a-9ce7-f0d1c9860b2d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:33.177076 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-0551db67-3368-478a-9ce7-f0d1c9860b2d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f/os-volume_attachments/528f6b86-d36b-4619-b6ea-25ece12bf1e1" status: 200 len: 194 microversion: 2.20 time: 0.046338 Aug 09 11:22:33.183516 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 355/672] 10.222.0.27 () {60 vars in 1454 bytes} [Tue Aug 9 11:22:33 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f/os-volume_attachments/528f6b86-d36b-4619-b6ea-25ece12bf1e1 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 11:22:33.248132 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-d49701b1-b489-4d9b-bdfb-61c7bab4ea22 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:22:33.249055 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-d49701b1-b489-4d9b-bdfb-61c7bab4ea22 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:22:33.256594 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d49701b1-b489-4d9b-bdfb-61c7bab4ea22 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:33.257082 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d49701b1-b489-4d9b-bdfb-61c7bab4ea22 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:33.257512 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d49701b1-b489-4d9b-bdfb-61c7bab4ea22 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:33.258207 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d49701b1-b489-4d9b-bdfb-61c7bab4ea22 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:33.258657 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d49701b1-b489-4d9b-bdfb-61c7bab4ea22 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:33.259078 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d49701b1-b489-4d9b-bdfb-61c7bab4ea22 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:33.348204 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.objects.instance [None req-d49701b1-b489-4d9b-bdfb-61c7bab4ea22 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lazy-loading 'services' on Instance uuid 69542c8c-90b6-49a4-aed3-c229168f215f {{(pid=117684) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:22:33.426364 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-d49701b1-b489-4d9b-bdfb-61c7bab4ea22 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "DELETE /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f/os-volume_attachments/528f6b86-d36b-4619-b6ea-25ece12bf1e1" status: 202 len: 0 microversion: 2.20 time: 0.184351 Aug 09 11:22:33.426817 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 318/673] 10.222.0.27 () {60 vars in 1457 bytes} [Tue Aug 9 11:22:33 2022] DELETE /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f/os-volume_attachments/528f6b86-d36b-4619-b6ea-25ece12bf1e1 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 11:22:33.435790 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-b34e62b2-1857-43c9-81b1-75e7f28bd5f1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:22:33.438281 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-b34e62b2-1857-43c9-81b1-75e7f28bd5f1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:22:33.444667 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b34e62b2-1857-43c9-81b1-75e7f28bd5f1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:33.445142 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b34e62b2-1857-43c9-81b1-75e7f28bd5f1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:33.445567 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b34e62b2-1857-43c9-81b1-75e7f28bd5f1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:33.446260 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b34e62b2-1857-43c9-81b1-75e7f28bd5f1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:33.446703 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b34e62b2-1857-43c9-81b1-75e7f28bd5f1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:33.447174 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b34e62b2-1857-43c9-81b1-75e7f28bd5f1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:33.479368 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-b34e62b2-1857-43c9-81b1-75e7f28bd5f1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047749 Aug 09 11:22:33.480039 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 356/674] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Aug 9 11:22:33 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 11:22:34.493810 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-449cb4fc-07d2-4828-abf7-a5216e71873d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:22:34.496517 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-449cb4fc-07d2-4828-abf7-a5216e71873d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:22:34.503262 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-449cb4fc-07d2-4828-abf7-a5216e71873d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:34.503804 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-449cb4fc-07d2-4828-abf7-a5216e71873d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:34.504360 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-449cb4fc-07d2-4828-abf7-a5216e71873d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:34.505134 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-449cb4fc-07d2-4828-abf7-a5216e71873d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:34.505648 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-449cb4fc-07d2-4828-abf7-a5216e71873d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:34.506124 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-449cb4fc-07d2-4828-abf7-a5216e71873d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:34.537962 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-449cb4fc-07d2-4828-abf7-a5216e71873d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049124 Aug 09 11:22:34.538576 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 319/675] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Aug 9 11:22:34 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:22:34.608072 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-0dd676b0-e6b1-46bd-9838-520275f6d6ef tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:22:34.608650 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-0dd676b0-e6b1-46bd-9838-520275f6d6ef tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:22:34.620050 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0dd676b0-e6b1-46bd-9838-520275f6d6ef tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:34.620639 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0dd676b0-e6b1-46bd-9838-520275f6d6ef tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:34.621070 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0dd676b0-e6b1-46bd-9838-520275f6d6ef tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:34.621763 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0dd676b0-e6b1-46bd-9838-520275f6d6ef tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:34.622202 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0dd676b0-e6b1-46bd-9838-520275f6d6ef tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:34.622614 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0dd676b0-e6b1-46bd-9838-520275f6d6ef tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:34.659204 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-0dd676b0-e6b1-46bd-9838-520275f6d6ef tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Going to try to terminate instance {{(pid=117685) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 11:22:34.747913 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-0dd676b0-e6b1-46bd-9838-520275f6d6ef tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "DELETE /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 204 len: 0 microversion: 2.20 time: 0.143293 Aug 09 11:22:34.748733 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 357/676] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Aug 9 11:22:34 2022] DELETE /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 11:22:34.757178 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-54517eda-7844-49c4-ab3c-5f184e005709 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:22:34.757808 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-54517eda-7844-49c4-ab3c-5f184e005709 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:22:34.763674 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-54517eda-7844-49c4-ab3c-5f184e005709 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:34.764148 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-54517eda-7844-49c4-ab3c-5f184e005709 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:34.764610 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-54517eda-7844-49c4-ab3c-5f184e005709 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:34.765282 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-54517eda-7844-49c4-ab3c-5f184e005709 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:34.765782 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-54517eda-7844-49c4-ab3c-5f184e005709 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:34.766281 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-54517eda-7844-49c4-ab3c-5f184e005709 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:34.909868 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-54517eda-7844-49c4-ab3c-5f184e005709 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:34.923151 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-54517eda-7844-49c4-ab3c-5f184e005709 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:34.924708 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-54517eda-7844-49c4-ab3c-5f184e005709 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:34.926066 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-54517eda-7844-49c4-ab3c-5f184e005709 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1722 microversion: 2.20 time: 0.172800 Aug 09 11:22:34.926880 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 320/677] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:22:34 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:22:35.960884 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-3f23109c-77ed-4e9e-9452-b5818bccd9e3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:22:35.961653 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-3f23109c-77ed-4e9e-9452-b5818bccd9e3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:22:35.970232 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3f23109c-77ed-4e9e-9452-b5818bccd9e3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:35.970714 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3f23109c-77ed-4e9e-9452-b5818bccd9e3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:35.971139 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3f23109c-77ed-4e9e-9452-b5818bccd9e3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:35.971827 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3f23109c-77ed-4e9e-9452-b5818bccd9e3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:35.972297 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3f23109c-77ed-4e9e-9452-b5818bccd9e3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:35.972724 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3f23109c-77ed-4e9e-9452-b5818bccd9e3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:36.105391 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-3f23109c-77ed-4e9e-9452-b5818bccd9e3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:36.117930 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-3f23109c-77ed-4e9e-9452-b5818bccd9e3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:36.120329 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-3f23109c-77ed-4e9e-9452-b5818bccd9e3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:36.122086 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-3f23109c-77ed-4e9e-9452-b5818bccd9e3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1722 microversion: 2.20 time: 0.167622 Aug 09 11:22:36.122898 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 358/678] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:22:35 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:22:37.147891 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-23c62887-9f81-4000-b753-c076ca7be393 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:22:37.148494 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-23c62887-9f81-4000-b753-c076ca7be393 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:22:37.155621 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-23c62887-9f81-4000-b753-c076ca7be393 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:37.156095 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-23c62887-9f81-4000-b753-c076ca7be393 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:37.156569 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-23c62887-9f81-4000-b753-c076ca7be393 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:37.157255 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-23c62887-9f81-4000-b753-c076ca7be393 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:37.157698 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-23c62887-9f81-4000-b753-c076ca7be393 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:37.158118 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-23c62887-9f81-4000-b753-c076ca7be393 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:37.293863 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-23c62887-9f81-4000-b753-c076ca7be393 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:37.302389 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-23c62887-9f81-4000-b753-c076ca7be393 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:37.303881 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-23c62887-9f81-4000-b753-c076ca7be393 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:37.305059 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-23c62887-9f81-4000-b753-c076ca7be393 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1722 microversion: 2.20 time: 0.161588 Aug 09 11:22:37.305620 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 321/679] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:22:37 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:22:38.337072 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-be9bfd0a-49d8-49bf-b7eb-3db1f73f333e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:22:38.337663 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-be9bfd0a-49d8-49bf-b7eb-3db1f73f333e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:22:38.344625 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-be9bfd0a-49d8-49bf-b7eb-3db1f73f333e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:38.345110 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-be9bfd0a-49d8-49bf-b7eb-3db1f73f333e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:38.345544 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-be9bfd0a-49d8-49bf-b7eb-3db1f73f333e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:38.346233 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-be9bfd0a-49d8-49bf-b7eb-3db1f73f333e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:38.346682 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-be9bfd0a-49d8-49bf-b7eb-3db1f73f333e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:38.347105 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-be9bfd0a-49d8-49bf-b7eb-3db1f73f333e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:38.495899 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-be9bfd0a-49d8-49bf-b7eb-3db1f73f333e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:38.504810 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-be9bfd0a-49d8-49bf-b7eb-3db1f73f333e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:38.506514 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-be9bfd0a-49d8-49bf-b7eb-3db1f73f333e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:38.507674 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-be9bfd0a-49d8-49bf-b7eb-3db1f73f333e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1722 microversion: 2.20 time: 0.174877 Aug 09 11:22:38.508242 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 359/680] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:22:38 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:22:39.538345 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-a5082459-c5a8-4001-8cbb-f1f7f61cea64 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:22:39.539160 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-a5082459-c5a8-4001-8cbb-f1f7f61cea64 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:22:39.545381 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a5082459-c5a8-4001-8cbb-f1f7f61cea64 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:39.545852 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a5082459-c5a8-4001-8cbb-f1f7f61cea64 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:39.546282 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a5082459-c5a8-4001-8cbb-f1f7f61cea64 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:39.547173 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a5082459-c5a8-4001-8cbb-f1f7f61cea64 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:39.547824 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a5082459-c5a8-4001-8cbb-f1f7f61cea64 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:39.548256 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a5082459-c5a8-4001-8cbb-f1f7f61cea64 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:40.030928 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-a5082459-c5a8-4001-8cbb-f1f7f61cea64 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:40.039877 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-a5082459-c5a8-4001-8cbb-f1f7f61cea64 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:40.041578 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-a5082459-c5a8-4001-8cbb-f1f7f61cea64 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:40.042850 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-a5082459-c5a8-4001-8cbb-f1f7f61cea64 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 200 len: 1722 microversion: 2.20 time: 0.508832 Aug 09 11:22:40.056631 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 322/681] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:22:39 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 1722 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:22:40.449655 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-9f509f16-e7c2-419c-8cd6-3225c6079e28 req-73f4008c-8a6f-4165-bf4d-81ac46b778a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69542c8c-90b6-49a4-aed3-c229168f215f", "name": "network-vif-deleted", "tag": "e9e1072a-3971-440e-9a60-ba15e5db60f3"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:22:40.462080 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-9f509f16-e7c2-419c-8cd6-3225c6079e28 req-73f4008c-8a6f-4165-bf4d-81ac46b778a5 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:40.462557 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-9f509f16-e7c2-419c-8cd6-3225c6079e28 req-73f4008c-8a6f-4165-bf4d-81ac46b778a5 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:40.462978 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-9f509f16-e7c2-419c-8cd6-3225c6079e28 req-73f4008c-8a6f-4165-bf4d-81ac46b778a5 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:40.478459 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-9f509f16-e7c2-419c-8cd6-3225c6079e28 req-73f4008c-8a6f-4165-bf4d-81ac46b778a5 service nova] Creating event network-vif-deleted:e9e1072a-3971-440e-9a60-ba15e5db60f3 for instance 69542c8c-90b6-49a4-aed3-c229168f215f on hv-cinder-85251 Aug 09 11:22:40.484070 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-9f509f16-e7c2-419c-8cd6-3225c6079e28 req-73f4008c-8a6f-4165-bf4d-81ac46b778a5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038754 Aug 09 11:22:40.484782 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 360/682] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:22:41.067719 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-718ba18c-0d13-44d2-857e-c961db1b4ad4 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:22:41.068362 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-718ba18c-0d13-44d2-857e-c961db1b4ad4 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:22:41.075488 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-718ba18c-0d13-44d2-857e-c961db1b4ad4 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:41.075967 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-718ba18c-0d13-44d2-857e-c961db1b4ad4 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:41.076416 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-718ba18c-0d13-44d2-857e-c961db1b4ad4 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:41.077183 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-718ba18c-0d13-44d2-857e-c961db1b4ad4 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:41.077633 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-718ba18c-0d13-44d2-857e-c961db1b4ad4 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:41.078036 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-718ba18c-0d13-44d2-857e-c961db1b4ad4 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:41.092856 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.wsgi [None req-718ba18c-0d13-44d2-857e-c961db1b4ad4 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] HTTP exception thrown: Instance 69542c8c-90b6-49a4-aed3-c229168f215f could not be found. Aug 09 11:22:41.095282 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-718ba18c-0d13-44d2-857e-c961db1b4ad4 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Request method failure captured: Aug 09 11:22:41.095282 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: request: GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f HTTP/1.1 Aug 09 11:22:41.095282 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept: application/json Aug 09 11:22:41.095282 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept-Encoding: identity Aug 09 11:22:41.095282 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Connection: close Aug 09 11:22:41.095282 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Length: 0 Aug 09 11:22:41.095282 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Type: application/json Aug 09 11:22:41.095282 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Host: 10.222.0.27 Aug 09 11:22:41.095282 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Openstack-System-Scope: None Aug 09 11:22:41.095282 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: User-Agent: python-urllib3/1.26.11 Aug 09 11:22:41.095282 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Auth-Token: gAAAAABi8kJpBpnG_KfTunZaXhc-EO5fHtNL1HlSN7oRXHqdxwDML8yRS2LJPv8qmd_BwUUYq-xXWY7UvtlBItZvGotU07WwI2ru5dt3qcvZiIAEh5lAl5czBtFgxWfLAUFXeEkh9rHMDZjbpZeDosT2C719tbtlt-9b5c0CeoyK5VMqKgV9ce4 Aug 09 11:22:41.095282 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Id: None Aug 09 11:22:41.095282 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Name: None Aug 09 11:22:41.095282 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Identity-Status: Confirmed Aug 09 11:22:41.095282 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Is-Admin-Project: True Aug 09 11:22:41.095282 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 11:22:41.095282 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Id: default Aug 09 11:22:41.095282 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Name: Default Aug 09 11:22:41.095282 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Id: f938fbc477f34eedb17c9ead3084a207 Aug 09 11:22:41.095282 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-793190908 Aug 09 11:22:41.095282 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Role: member,reader Aug 09 11:22:41.095282 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Roles: member,reader Aug 09 11:22:41.096754 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f938fbc477f34eedb17c9ead3084a207"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f938fbc477f34eedb17c9ead3084a207"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f938fbc477f34eedb17c9ead3084a207"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f938fbc477f34eedb17c9ead3084a207"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:22:41.096754 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant: tempest-AttachVolumeShelveTestJSON-793190908 Aug 09 11:22:41.096754 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Id: f938fbc477f34eedb17c9ead3084a207 Aug 09 11:22:41.096754 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-793190908 Aug 09 11:22:41.096754 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User: tempest-AttachVolumeShelveTestJSON-793190908-project Aug 09 11:22:41.096754 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Id: default Aug 09 11:22:41.096754 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Name: Default Aug 09 11:22:41.096754 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Id: 2e6543b377f14949a6919af4e4e187b7 Aug 09 11:22:41.096754 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Name: tempest-AttachVolumeShelveTestJSON-793190908-project Aug 09 11:22:41.096754 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: method: > Aug 09 11:22:41.096754 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: exception: Instance 69542c8c-90b6-49a4-aed3-c229168f215f could not be found. Aug 09 11:22:41.096754 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: action_args: {'id': '69542c8c-90b6-49a4-aed3-c229168f215f'} Aug 09 11:22:41.097712 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:22:41.097712 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:22:41.097712 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:22:41.097712 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:22:41.097712 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:22:41.097712 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:22:41.097712 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:22:41.097712 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:22:41.097712 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:22:41.097712 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:22:41.097712 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69542c8c-90b6-49a4-aed3-c229168f215f could not be found. Aug 09 11:22:41.097712 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:22:41.097712 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:22:41.097712 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:22:41.097712 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:22:41.097712 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:22:41.097712 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:22:41.097712 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:22:41.097712 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:22:41.097712 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:22:41.099910 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:22:41.099910 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:22:41.099910 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:22:41.099910 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:22:41.099910 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:22:41.099910 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:22:41.099910 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:22:41.099910 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69542c8c-90b6-49a4-aed3-c229168f215f could not be found. Aug 09 11:22:41.099910 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:22:41.099910 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:22:41.099910 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:22:41.099910 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:22:41.099910 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:22:41.099910 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:22:41.099910 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:22:41.099910 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:22:41.099910 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69542c8c-90b6-49a4-aed3-c229168f215f could not be found. Aug 09 11:22:41.099910 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:22:41.101430 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-718ba18c-0d13-44d2-857e-c961db1b4ad4 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Returning 404 to user: Instance 69542c8c-90b6-49a4-aed3-c229168f215f could not be found. {{(pid=117684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:22:41.101430 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-718ba18c-0d13-44d2-857e-c961db1b4ad4 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 404 len: 111 microversion: 2.20 time: 0.033645 Aug 09 11:22:41.101430 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 323/683] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:22:41 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 11:22:41.106507 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-6484e76b-1a4c-4de6-9150-632e97c5a566 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '.version_select at 0x7f2821ed4ca0>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:22:41.127688 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-6484e76b-1a4c-4de6-9150-632e97c5a566 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1295999284" status: 204 len: 0 microversion: 2.20 time: 0.024996 Aug 09 11:22:41.127891 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 361/684] 10.222.0.27 () {60 vars in 1262 bytes} [Tue Aug 9 11:22:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1295999284 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 11:22:41.815315 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-f7b218b6-0416-48a4-86c1-f75255c86ce1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Action: 'create', calling method: .version_select at 0x7f282207daf0>, body: {"keypair": {"name": "tempest-keypair-475185723", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGhiNKPIkTbKHs9SOvad7mdlZJ+zIWzuODdExe/sDX3NEsfVHs4lEQCrR6sfCduxSVglj8kFM+9odcnt/d32OtL8Ttte7AzRwVbhvX0K6dXxr7QRxkTZJXUxtFcQyKddWQ=="}} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:22:41.831899 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.quota [None req-f7b218b6-0416-48a4-86c1-f75255c86ce1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Getting quotas for project f938fbc477f34eedb17c9ead3084a207. Resources: {'key_pairs'} {{(pid=117684) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:22:41.836299 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.quota [None req-f7b218b6-0416-48a4-86c1-f75255c86ce1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Getting quotas for user 2e6543b377f14949a6919af4e4e187b7 and project f938fbc477f34eedb17c9ead3084a207. Resources: {'key_pairs'} {{(pid=117684) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:22:41.861993 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-f7b218b6-0416-48a4-86c1-f75255c86ce1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.050741 Aug 09 11:22:41.862571 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 324/685] 10.222.0.27 () {62 vars in 1200 bytes} [Tue Aug 9 11:22:41 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 52 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 09 11:22:43.210090 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-82312122-0525-40d7-bc3c-b9850829ff69 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1962893550", "imageRef": "2321e9a0-fe0f-47fd-9c4b-8868eb5a00af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f4545659-27a2-43ba-a7bb-5771ac314449"}], "security_groups": [{"name": "tempest-securitygroup--1405006744"}], "key_name": "tempest-keypair-475185723", "user_data": "}} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:22:43.330751 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.network.neutron [None req-82312122-0525-40d7-bc3c-b9850829ff69 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] validate_networks() for [('f4545659-27a2-43ba-a7bb-5771ac314449', None, None, None, None, None)] {{(pid=117685) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 11:22:43.741305 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-82312122-0525-40d7-bc3c-b9850829ff69 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Flavor limits 0:0:0 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 11:22:43.741727 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-82312122-0525-40d7-bc3c-b9850829ff69 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Image limits 0:0:0 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 11:22:43.742192 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-82312122-0525-40d7-bc3c-b9850829ff69 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Flavor pref 0:0:0 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 11:22:43.742607 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-82312122-0525-40d7-bc3c-b9850829ff69 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Image pref 0:0:0 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 11:22:43.743238 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-82312122-0525-40d7-bc3c-b9850829ff69 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 11:22:43.754346 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-82312122-0525-40d7-bc3c-b9850829ff69 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:43.754845 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-82312122-0525-40d7-bc3c-b9850829ff69 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:43.755266 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-82312122-0525-40d7-bc3c-b9850829ff69 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:43.755980 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-82312122-0525-40d7-bc3c-b9850829ff69 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:43.756450 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-82312122-0525-40d7-bc3c-b9850829ff69 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:43.756835 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-82312122-0525-40d7-bc3c-b9850829ff69 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:43.773732 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.quota [None req-82312122-0525-40d7-bc3c-b9850829ff69 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Getting quotas for project f938fbc477f34eedb17c9ead3084a207. Resources: {'cores', 'instances', 'ram'} {{(pid=117685) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:22:43.777538 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.quota [None req-82312122-0525-40d7-bc3c-b9850829ff69 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Getting quotas for user 2e6543b377f14949a6919af4e4e187b7 and project f938fbc477f34eedb17c9ead3084a207. Resources: {'cores', 'instances', 'ram'} {{(pid=117685) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:22:43.788886 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-82312122-0525-40d7-bc3c-b9850829ff69 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Going to run 1 instances... {{(pid=117685) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 11:22:43.791273 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-82312122-0525-40d7-bc3c-b9850829ff69 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2321e9a0-fe0f-47fd-9c4b-8868eb5a00af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117685) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 11:22:43.838918 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-82312122-0525-40d7-bc3c-b9850829ff69 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.633720 Aug 09 11:22:43.839573 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 362/686] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Aug 9 11:22:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 635 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 09 11:22:43.853490 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-61c66661-1b62-4097-b120-1f1ad21029ac tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:22:43.854130 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-61c66661-1b62-4097-b120-1f1ad21029ac tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:22:44.073798 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-61c66661-1b62-4097-b120-1f1ad21029ac tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:44.082082 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-61c66661-1b62-4097-b120-1f1ad21029ac tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:44.083569 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-61c66661-1b62-4097-b120-1f1ad21029ac tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:44.084761 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-61c66661-1b62-4097-b120-1f1ad21029ac tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1281 microversion: 2.20 time: 0.237505 Aug 09 11:22:44.085304 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 325/687] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:22:43 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1281 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:22:45.107648 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-d6667865-171a-4589-9880-a2e02f398bf9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:22:45.108247 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-d6667865-171a-4589-9880-a2e02f398bf9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:22:45.116214 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d6667865-171a-4589-9880-a2e02f398bf9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:45.116726 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d6667865-171a-4589-9880-a2e02f398bf9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:45.117154 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d6667865-171a-4589-9880-a2e02f398bf9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:45.117844 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d6667865-171a-4589-9880-a2e02f398bf9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:45.118287 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d6667865-171a-4589-9880-a2e02f398bf9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:45.118819 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d6667865-171a-4589-9880-a2e02f398bf9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:45.247535 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-d6667865-171a-4589-9880-a2e02f398bf9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:45.256854 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-d6667865-171a-4589-9880-a2e02f398bf9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:45.258317 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-d6667865-171a-4589-9880-a2e02f398bf9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:45.259475 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-d6667865-171a-4589-9880-a2e02f398bf9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1339 microversion: 2.20 time: 0.156480 Aug 09 11:22:45.260034 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 363/688] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:22:45 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1339 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:22:46.283108 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-6bdf14a8-bbb4-4b43-b219-b736c4534f04 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:22:46.283707 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-6bdf14a8-bbb4-4b43-b219-b736c4534f04 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:22:46.290397 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6bdf14a8-bbb4-4b43-b219-b736c4534f04 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:46.290873 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6bdf14a8-bbb4-4b43-b219-b736c4534f04 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:46.291309 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6bdf14a8-bbb4-4b43-b219-b736c4534f04 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:46.291998 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6bdf14a8-bbb4-4b43-b219-b736c4534f04 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:46.292486 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6bdf14a8-bbb4-4b43-b219-b736c4534f04 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:46.292908 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6bdf14a8-bbb4-4b43-b219-b736c4534f04 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:46.352028 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-4a8b41f9-10ce-4e87-b954-712af6416e3f req-6369d50e-f308-4e6c-baf8-0873ba86e8f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "919c3009-894a-45e2-bc25-24df397fa3d0", "tag": "2572315b-325e-49c1-b65d-1b98ef984660"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:22:46.370490 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-4a8b41f9-10ce-4e87-b954-712af6416e3f req-6369d50e-f308-4e6c-baf8-0873ba86e8f5 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:46.370874 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-4a8b41f9-10ce-4e87-b954-712af6416e3f req-6369d50e-f308-4e6c-baf8-0873ba86e8f5 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:46.371294 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-4a8b41f9-10ce-4e87-b954-712af6416e3f req-6369d50e-f308-4e6c-baf8-0873ba86e8f5 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:46.382747 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-4a8b41f9-10ce-4e87-b954-712af6416e3f req-6369d50e-f308-4e6c-baf8-0873ba86e8f5 service nova] Creating event network-changed:2572315b-325e-49c1-b65d-1b98ef984660 for instance 919c3009-894a-45e2-bc25-24df397fa3d0 on hv-cinder-85251 Aug 09 11:22:46.387494 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-4a8b41f9-10ce-4e87-b954-712af6416e3f req-6369d50e-f308-4e6c-baf8-0873ba86e8f5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039204 Aug 09 11:22:46.388189 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 364/689] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:22:46.560931 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-6bdf14a8-bbb4-4b43-b219-b736c4534f04 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:46.569873 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-6bdf14a8-bbb4-4b43-b219-b736c4534f04 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:46.571497 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-6bdf14a8-bbb4-4b43-b219-b736c4534f04 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:46.572626 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-6bdf14a8-bbb4-4b43-b219-b736c4534f04 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1407 microversion: 2.20 time: 0.293489 Aug 09 11:22:46.573251 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 326/690] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:22:46 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1407 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:22:47.598375 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-a0edf776-b909-48d0-81d1-78e8d4f0c377 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:22:47.599083 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-a0edf776-b909-48d0-81d1-78e8d4f0c377 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:22:47.605880 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a0edf776-b909-48d0-81d1-78e8d4f0c377 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:47.606366 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a0edf776-b909-48d0-81d1-78e8d4f0c377 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:47.606805 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a0edf776-b909-48d0-81d1-78e8d4f0c377 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:47.607494 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a0edf776-b909-48d0-81d1-78e8d4f0c377 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:47.607945 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a0edf776-b909-48d0-81d1-78e8d4f0c377 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:47.608413 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a0edf776-b909-48d0-81d1-78e8d4f0c377 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:47.741151 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-a0edf776-b909-48d0-81d1-78e8d4f0c377 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:47.754509 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-a0edf776-b909-48d0-81d1-78e8d4f0c377 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:47.756914 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-a0edf776-b909-48d0-81d1-78e8d4f0c377 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:47.758603 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-a0edf776-b909-48d0-81d1-78e8d4f0c377 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1407 microversion: 2.20 time: 0.164827 Aug 09 11:22:47.759451 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 365/691] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:22:47 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:22:48.400323 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-3ae5d850-a61d-403c-a778-9254225e94e6 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:22:48.402511 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-3ae5d850-a61d-403c-a778-9254225e94e6 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:22:48.410250 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3ae5d850-a61d-403c-a778-9254225e94e6 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:48.410373 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3ae5d850-a61d-403c-a778-9254225e94e6 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:48.410738 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3ae5d850-a61d-403c-a778-9254225e94e6 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:48.411506 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3ae5d850-a61d-403c-a778-9254225e94e6 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:48.411971 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3ae5d850-a61d-403c-a778-9254225e94e6 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:48.412600 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3ae5d850-a61d-403c-a778-9254225e94e6 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:48.446811 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-3ae5d850-a61d-403c-a778-9254225e94e6 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053575 Aug 09 11:22:48.447568 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 327/692] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 9 11:22:48 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 11:22:48.509080 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-91c6411d-76af-438d-8338-5bd303d43fbb tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:22:48.509570 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-91c6411d-76af-438d-8338-5bd303d43fbb tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:22:48.515739 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-91c6411d-76af-438d-8338-5bd303d43fbb tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:48.516420 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-91c6411d-76af-438d-8338-5bd303d43fbb tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:48.516859 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-91c6411d-76af-438d-8338-5bd303d43fbb tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:48.517580 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-91c6411d-76af-438d-8338-5bd303d43fbb tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:48.518117 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-91c6411d-76af-438d-8338-5bd303d43fbb tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:48.518540 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-91c6411d-76af-438d-8338-5bd303d43fbb tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:48.544864 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-91c6411d-76af-438d-8338-5bd303d43fbb tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Going to try to terminate instance {{(pid=117685) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 11:22:48.623259 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-91c6411d-76af-438d-8338-5bd303d43fbb tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 204 len: 0 microversion: 2.1 time: 0.117935 Aug 09 11:22:48.624171 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 366/693] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 9 11:22:48 2022] DELETE /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 11:22:48.633713 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-b3dd915f-2bf4-46c9-be45-fad73c9d9c03 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:22:48.634403 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-b3dd915f-2bf4-46c9-be45-fad73c9d9c03 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:22:48.643312 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b3dd915f-2bf4-46c9-be45-fad73c9d9c03 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:48.644166 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b3dd915f-2bf4-46c9-be45-fad73c9d9c03 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:48.645342 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b3dd915f-2bf4-46c9-be45-fad73c9d9c03 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:48.646591 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b3dd915f-2bf4-46c9-be45-fad73c9d9c03 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:48.647254 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b3dd915f-2bf4-46c9-be45-fad73c9d9c03 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:48.647857 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b3dd915f-2bf4-46c9-be45-fad73c9d9c03 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:48.786778 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-7e1b2ecf-8d5a-4e39-9684-ddcca33fccf0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:22:48.787478 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-7e1b2ecf-8d5a-4e39-9684-ddcca33fccf0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:22:48.788787 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-b3dd915f-2bf4-46c9-be45-fad73c9d9c03 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:48.794083 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7e1b2ecf-8d5a-4e39-9684-ddcca33fccf0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:48.794559 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7e1b2ecf-8d5a-4e39-9684-ddcca33fccf0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:48.795067 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7e1b2ecf-8d5a-4e39-9684-ddcca33fccf0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:48.795803 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7e1b2ecf-8d5a-4e39-9684-ddcca33fccf0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:48.796252 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7e1b2ecf-8d5a-4e39-9684-ddcca33fccf0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:48.796685 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7e1b2ecf-8d5a-4e39-9684-ddcca33fccf0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:48.797719 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-b3dd915f-2bf4-46c9-be45-fad73c9d9c03 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1673 microversion: 2.1 time: 0.168885 Aug 09 11:22:48.798361 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 328/694] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:22:48 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1673 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:22:48.802373 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:22:48.939947 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-7e1b2ecf-8d5a-4e39-9684-ddcca33fccf0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:48.948361 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-7e1b2ecf-8d5a-4e39-9684-ddcca33fccf0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:48.949874 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-7e1b2ecf-8d5a-4e39-9684-ddcca33fccf0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:48.950983 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-7e1b2ecf-8d5a-4e39-9684-ddcca33fccf0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1407 microversion: 2.20 time: 0.169386 Aug 09 11:22:48.951513 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 367/695] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:22:48 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 11:22:49.823481 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-2c9c4b46-8cfd-4bdf-acc7-a4f989022b1d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:22:49.824045 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-2c9c4b46-8cfd-4bdf-acc7-a4f989022b1d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:22:49.832050 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2c9c4b46-8cfd-4bdf-acc7-a4f989022b1d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:49.832572 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2c9c4b46-8cfd-4bdf-acc7-a4f989022b1d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:49.833003 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2c9c4b46-8cfd-4bdf-acc7-a4f989022b1d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:49.833711 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2c9c4b46-8cfd-4bdf-acc7-a4f989022b1d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:49.834153 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2c9c4b46-8cfd-4bdf-acc7-a4f989022b1d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:49.834568 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2c9c4b46-8cfd-4bdf-acc7-a4f989022b1d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:49.973806 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-a0d24f45-64f6-4a55-af5d-71821178505a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:22:49.974535 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-a0d24f45-64f6-4a55-af5d-71821178505a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:22:49.981514 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a0d24f45-64f6-4a55-af5d-71821178505a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:49.982004 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a0d24f45-64f6-4a55-af5d-71821178505a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:49.982428 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a0d24f45-64f6-4a55-af5d-71821178505a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:49.983140 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a0d24f45-64f6-4a55-af5d-71821178505a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:49.983577 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a0d24f45-64f6-4a55-af5d-71821178505a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:49.983993 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a0d24f45-64f6-4a55-af5d-71821178505a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:50.389934 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-a0d24f45-64f6-4a55-af5d-71821178505a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:50.395970 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-2c9c4b46-8cfd-4bdf-acc7-a4f989022b1d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:50.404011 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-a0d24f45-64f6-4a55-af5d-71821178505a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:50.405729 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-a0d24f45-64f6-4a55-af5d-71821178505a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:50.406832 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-a0d24f45-64f6-4a55-af5d-71821178505a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1407 microversion: 2.20 time: 0.437216 Aug 09 11:22:50.408240 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 368/696] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:22:49 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1407 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:22:50.408729 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-2c9c4b46-8cfd-4bdf-acc7-a4f989022b1d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1673 microversion: 2.1 time: 0.587494 Aug 09 11:22:50.409298 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 329/697] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:22:49 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1673 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:22:51.430361 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-b28186b4-cb2f-44cb-9c39-c927c9ec01c8 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:22:51.430834 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-b28186b4-cb2f-44cb-9c39-c927c9ec01c8 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:22:51.432892 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-4c307200-bc44-478f-9f20-d33c6ad62837 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:22:51.433627 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-4c307200-bc44-478f-9f20-d33c6ad62837 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:22:51.437038 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b28186b4-cb2f-44cb-9c39-c927c9ec01c8 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:51.437527 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b28186b4-cb2f-44cb-9c39-c927c9ec01c8 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:51.437956 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b28186b4-cb2f-44cb-9c39-c927c9ec01c8 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:51.438819 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b28186b4-cb2f-44cb-9c39-c927c9ec01c8 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:51.439632 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b28186b4-cb2f-44cb-9c39-c927c9ec01c8 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:51.440060 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b28186b4-cb2f-44cb-9c39-c927c9ec01c8 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:51.444094 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:22:51.445755 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4c307200-bc44-478f-9f20-d33c6ad62837 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:51.448399 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4c307200-bc44-478f-9f20-d33c6ad62837 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:51.448745 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4c307200-bc44-478f-9f20-d33c6ad62837 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:51.449454 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4c307200-bc44-478f-9f20-d33c6ad62837 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:51.450535 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4c307200-bc44-478f-9f20-d33c6ad62837 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:51.451648 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4c307200-bc44-478f-9f20-d33c6ad62837 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:51.467439 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=2 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:22:51.745197 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-b28186b4-cb2f-44cb-9c39-c927c9ec01c8 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:51.753188 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-b28186b4-cb2f-44cb-9c39-c927c9ec01c8 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1673 microversion: 2.1 time: 0.326977 Aug 09 11:22:51.764298 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 369/698] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:22:51 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1673 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:22:51.764298 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-1e54ce2f-ce02-43c2-b74e-9f75a2764428 req-12388593-5a50-4f71-98e2-fffe293b5ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "919c3009-894a-45e2-bc25-24df397fa3d0", "name": "network-vif-plugged", "status": "completed", "tag": "2572315b-325e-49c1-b65d-1b98ef984660"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:22:51.770931 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-1e54ce2f-ce02-43c2-b74e-9f75a2764428 req-12388593-5a50-4f71-98e2-fffe293b5ab3 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:51.771659 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-1e54ce2f-ce02-43c2-b74e-9f75a2764428 req-12388593-5a50-4f71-98e2-fffe293b5ab3 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:51.772407 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-1e54ce2f-ce02-43c2-b74e-9f75a2764428 req-12388593-5a50-4f71-98e2-fffe293b5ab3 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:51.787255 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-4c307200-bc44-478f-9f20-d33c6ad62837 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:51.792375 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-1e54ce2f-ce02-43c2-b74e-9f75a2764428 req-12388593-5a50-4f71-98e2-fffe293b5ab3 service nova] Creating event network-vif-plugged:2572315b-325e-49c1-b65d-1b98ef984660 for instance 919c3009-894a-45e2-bc25-24df397fa3d0 on hv-cinder-85251 Aug 09 11:22:51.798067 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-1e54ce2f-ce02-43c2-b74e-9f75a2764428 req-12388593-5a50-4f71-98e2-fffe293b5ab3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042647 Aug 09 11:22:51.799050 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 370/699] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:22:51.802290 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-4c307200-bc44-478f-9f20-d33c6ad62837 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:51.803782 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-4c307200-bc44-478f-9f20-d33c6ad62837 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:51.804928 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-4c307200-bc44-478f-9f20-d33c6ad62837 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1407 microversion: 2.20 time: 0.377814 Aug 09 11:22:51.820428 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 330/700] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:22:51 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1407 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:22:52.198472 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-b19a529d-5c14-47e4-8641-0c59441c20a7 req-30756899-b528-444a-97c9-56824f0b7566 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb805071-5bf8-4c52-9f89-b4bb1272121f", "name": "network-vif-deleted", "tag": "9c7f1d85-6e6c-4baa-88fa-0db4c9faf571"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:22:52.213118 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:22:52.217497 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-b19a529d-5c14-47e4-8641-0c59441c20a7 req-30756899-b528-444a-97c9-56824f0b7566 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:52.218115 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-b19a529d-5c14-47e4-8641-0c59441c20a7 req-30756899-b528-444a-97c9-56824f0b7566 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:52.218923 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-b19a529d-5c14-47e4-8641-0c59441c20a7 req-30756899-b528-444a-97c9-56824f0b7566 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:52.232676 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-b19a529d-5c14-47e4-8641-0c59441c20a7 req-30756899-b528-444a-97c9-56824f0b7566 service nova] Creating event network-vif-deleted:9c7f1d85-6e6c-4baa-88fa-0db4c9faf571 for instance fb805071-5bf8-4c52-9f89-b4bb1272121f on hv-cinder-85251 Aug 09 11:22:52.239865 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-b19a529d-5c14-47e4-8641-0c59441c20a7 req-30756899-b528-444a-97c9-56824f0b7566 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048956 Aug 09 11:22:52.241763 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 371/701] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:22:52.778173 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-8dcd6aa4-78df-4d9e-a6cb-ff2ed76d2a0a tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:22:52.778922 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-8dcd6aa4-78df-4d9e-a6cb-ff2ed76d2a0a tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:22:52.786986 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8dcd6aa4-78df-4d9e-a6cb-ff2ed76d2a0a tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:52.787837 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8dcd6aa4-78df-4d9e-a6cb-ff2ed76d2a0a tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:52.788133 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8dcd6aa4-78df-4d9e-a6cb-ff2ed76d2a0a tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:52.789148 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8dcd6aa4-78df-4d9e-a6cb-ff2ed76d2a0a tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:52.789856 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8dcd6aa4-78df-4d9e-a6cb-ff2ed76d2a0a tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:52.790278 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8dcd6aa4-78df-4d9e-a6cb-ff2ed76d2a0a tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:52.830709 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8dcd6aa4-78df-4d9e-a6cb-ff2ed76d2a0a tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:52.831762 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8dcd6aa4-78df-4d9e-a6cb-ff2ed76d2a0a tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:52.832192 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8dcd6aa4-78df-4d9e-a6cb-ff2ed76d2a0a tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:52.832741 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.objects.instance [None req-8dcd6aa4-78df-4d9e-a6cb-ff2ed76d2a0a tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lazy-loading 'fault' on Instance uuid fb805071-5bf8-4c52-9f89-b4bb1272121f {{(pid=117684) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:22:52.837963 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-fffde6e3-ccd9-42c4-ba08-b6a99ce7afc3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:22:52.839423 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-fffde6e3-ccd9-42c4-ba08-b6a99ce7afc3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:22:52.848395 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fffde6e3-ccd9-42c4-ba08-b6a99ce7afc3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:52.848882 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fffde6e3-ccd9-42c4-ba08-b6a99ce7afc3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:52.849493 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fffde6e3-ccd9-42c4-ba08-b6a99ce7afc3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:52.850233 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fffde6e3-ccd9-42c4-ba08-b6a99ce7afc3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:52.850683 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fffde6e3-ccd9-42c4-ba08-b6a99ce7afc3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:52.851106 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fffde6e3-ccd9-42c4-ba08-b6a99ce7afc3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:52.900734 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-8dcd6aa4-78df-4d9e-a6cb-ff2ed76d2a0a tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:52.921285 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-8dcd6aa4-78df-4d9e-a6cb-ff2ed76d2a0a tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 200 len: 1327 microversion: 2.1 time: 0.149364 Aug 09 11:22:52.926229 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 331/702] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:22:52 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 1327 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:22:53.118246 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-fffde6e3-ccd9-42c4-ba08-b6a99ce7afc3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:53.127323 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-fffde6e3-ccd9-42c4-ba08-b6a99ce7afc3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:53.129341 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-fffde6e3-ccd9-42c4-ba08-b6a99ce7afc3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:53.130526 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-fffde6e3-ccd9-42c4-ba08-b6a99ce7afc3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1407 microversion: 2.20 time: 0.304853 Aug 09 11:22:53.131139 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 372/703] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:22:52 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1407 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:22:54.079473 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell0:SELECT=6 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:22:54.153752 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-29a746e7-3185-4f97-b2a3-7f891fa4cfcb tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:22:54.154354 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-29a746e7-3185-4f97-b2a3-7f891fa4cfcb tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:22:54.156359 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell0:SELECT=2 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:22:54.157664 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell0:SELECT=6 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:22:54.163440 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-29a746e7-3185-4f97-b2a3-7f891fa4cfcb tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:54.163917 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-29a746e7-3185-4f97-b2a3-7f891fa4cfcb tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:54.164564 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-ae85f32d-9179-4a54-93b7-da6de73cb656 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:22:54.164692 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-29a746e7-3185-4f97-b2a3-7f891fa4cfcb tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:54.165401 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-ae85f32d-9179-4a54-93b7-da6de73cb656 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:22:54.165700 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-29a746e7-3185-4f97-b2a3-7f891fa4cfcb tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:54.166296 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-29a746e7-3185-4f97-b2a3-7f891fa4cfcb tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:54.166865 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-29a746e7-3185-4f97-b2a3-7f891fa4cfcb tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:54.173701 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ae85f32d-9179-4a54-93b7-da6de73cb656 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:54.174487 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ae85f32d-9179-4a54-93b7-da6de73cb656 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:54.175299 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ae85f32d-9179-4a54-93b7-da6de73cb656 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:54.175620 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ae85f32d-9179-4a54-93b7-da6de73cb656 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:54.176236 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ae85f32d-9179-4a54-93b7-da6de73cb656 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:54.176884 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ae85f32d-9179-4a54-93b7-da6de73cb656 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:54.197589 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.wsgi [None req-ae85f32d-9179-4a54-93b7-da6de73cb656 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] HTTP exception thrown: Instance fb805071-5bf8-4c52-9f89-b4bb1272121f could not be found. Aug 09 11:22:54.199251 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-ae85f32d-9179-4a54-93b7-da6de73cb656 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Request method failure captured: Aug 09 11:22:54.199251 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: request: GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f HTTP/1.1 Aug 09 11:22:54.199251 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept: application/json Aug 09 11:22:54.199251 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept-Encoding: identity Aug 09 11:22:54.199251 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Connection: close Aug 09 11:22:54.199251 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Length: 0 Aug 09 11:22:54.199251 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Type: application/json Aug 09 11:22:54.199251 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Host: 10.222.0.27 Aug 09 11:22:54.199251 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Openstack-System-Scope: None Aug 09 11:22:54.199251 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: User-Agent: python-urllib3/1.26.11 Aug 09 11:22:54.199251 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Auth-Token: gAAAAABi8kJiP2rs-oyULagIWrQ8NK_q4zXCHu9nG4Fnlj5pti_3VSho1aiTw6A41IJOWnMplxYLUKxat19aejWmXOFV77R-MAOlKM-vVw982IRFRnt_0EpXq4kj4KyUHdG5ruXClspZmnaRjeV1WKqLODbLz7uBlJF1UQfZRiYelCeatKLyefE Aug 09 11:22:54.199251 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Id: None Aug 09 11:22:54.199251 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Name: None Aug 09 11:22:54.199251 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Identity-Status: Confirmed Aug 09 11:22:54.199251 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Is-Admin-Project: True Aug 09 11:22:54.199251 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Id: default Aug 09 11:22:54.199251 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Name: Default Aug 09 11:22:54.199251 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Id: 06dd1efa43b043cf84f9808305d97bf0 Aug 09 11:22:54.199251 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Name: tempest-AttachVolumeTestJSON-1041146077 Aug 09 11:22:54.199251 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Role: member,reader Aug 09 11:22:54.199251 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Roles: member,reader Aug 09 11:22:54.200928 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/06dd1efa43b043cf84f9808305d97bf0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_06dd1efa43b043cf84f9808305d97bf0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/06dd1efa43b043cf84f9808305d97bf0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/06dd1efa43b043cf84f9808305d97bf0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:22:54.200928 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant: tempest-AttachVolumeTestJSON-1041146077 Aug 09 11:22:54.200928 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Id: 06dd1efa43b043cf84f9808305d97bf0 Aug 09 11:22:54.200928 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1041146077 Aug 09 11:22:54.200928 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User: tempest-AttachVolumeTestJSON-1041146077-project Aug 09 11:22:54.200928 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Id: default Aug 09 11:22:54.200928 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Name: Default Aug 09 11:22:54.200928 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Id: 601782d5743c47f380358021be28cc91 Aug 09 11:22:54.200928 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Name: tempest-AttachVolumeTestJSON-1041146077-project Aug 09 11:22:54.200928 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: method: > Aug 09 11:22:54.200928 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: exception: Instance fb805071-5bf8-4c52-9f89-b4bb1272121f could not be found. Aug 09 11:22:54.200928 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: action_args: {'id': 'fb805071-5bf8-4c52-9f89-b4bb1272121f'} Aug 09 11:22:54.201818 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:22:54.201818 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:22:54.201818 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:22:54.201818 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:22:54.201818 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:22:54.201818 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:22:54.201818 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:22:54.201818 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:22:54.201818 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:22:54.201818 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:22:54.201818 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb805071-5bf8-4c52-9f89-b4bb1272121f could not be found. Aug 09 11:22:54.201818 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:22:54.201818 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:22:54.201818 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:22:54.201818 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:22:54.201818 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:22:54.201818 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:22:54.201818 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:22:54.201818 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:22:54.201818 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:22:54.203395 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:22:54.203395 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:22:54.203395 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:22:54.203395 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:22:54.203395 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:22:54.203395 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:22:54.203395 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:22:54.203395 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb805071-5bf8-4c52-9f89-b4bb1272121f could not be found. Aug 09 11:22:54.203395 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:22:54.203395 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:22:54.203395 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:22:54.203395 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:22:54.203395 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:22:54.203395 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:22:54.203395 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:22:54.203395 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:22:54.203395 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb805071-5bf8-4c52-9f89-b4bb1272121f could not be found. Aug 09 11:22:54.203395 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:22:54.206602 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-ae85f32d-9179-4a54-93b7-da6de73cb656 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Returning 404 to user: Instance fb805071-5bf8-4c52-9f89-b4bb1272121f could not be found. {{(pid=117684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:22:54.207647 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-ae85f32d-9179-4a54-93b7-da6de73cb656 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 404 len: 111 microversion: 2.1 time: 0.266892 Aug 09 11:22:54.208391 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 332/704] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:22:53 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 111 bytes in 270 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:22:54.224258 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-633bcb77-19f8-4a4e-b69d-bb53ac4827c2 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '.version_select at 0x7f2821e2d550>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:22:54.253259 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-633bcb77-19f8-4a4e-b69d-bb53ac4827c2 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-910005796" status: 202 len: 0 microversion: 2.1 time: 0.036502 Aug 09 11:22:54.266796 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 333/705] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Aug 9 11:22:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-910005796 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:22:54.632144 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-29a746e7-3185-4f97-b2a3-7f891fa4cfcb tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:54.643032 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-29a746e7-3185-4f97-b2a3-7f891fa4cfcb tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:54.645934 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-29a746e7-3185-4f97-b2a3-7f891fa4cfcb tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:54.647573 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-29a746e7-3185-4f97-b2a3-7f891fa4cfcb tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1600 microversion: 2.20 time: 0.497868 Aug 09 11:22:54.648139 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 373/706] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:22:54 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1600 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 11:22:54.670588 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-3acb7ff9-3df2-4736-a352-9d1cbb1461b0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:22:54.671399 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-3acb7ff9-3df2-4736-a352-9d1cbb1461b0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:22:54.680047 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3acb7ff9-3df2-4736-a352-9d1cbb1461b0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:54.680844 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3acb7ff9-3df2-4736-a352-9d1cbb1461b0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:54.681468 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3acb7ff9-3df2-4736-a352-9d1cbb1461b0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:54.682392 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3acb7ff9-3df2-4736-a352-9d1cbb1461b0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:54.683062 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3acb7ff9-3df2-4736-a352-9d1cbb1461b0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:54.683708 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3acb7ff9-3df2-4736-a352-9d1cbb1461b0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:54.808650 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-3acb7ff9-3df2-4736-a352-9d1cbb1461b0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.142183 Aug 09 11:22:54.809784 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 334/707] 10.222.0.27 () {60 vars in 1316 bytes} [Tue Aug 9 11:22:54 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0/os-interface => generated 285 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 11:22:55.138767 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-20803fe7-9175-4eda-b4af-126f21002068 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Action: 'create', calling method: .version_select at 0x7f2821eebaf0>, body: {"keypair": {"name": "tempest-keypair-293088370", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN0qsNHjx5mXVkA5q2eqL4yLCTcqrEP2W8E+RvAhn0aNASEAJ8o3QfUzf4X/QQodClnajONbgR+zQ1PaNEdrR6J4fYF3/i5ReNWW8CaRdABd0R3q337LqpHS5U4fYHNXBg=="}} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:22:55.173431 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.quota [None req-20803fe7-9175-4eda-b4af-126f21002068 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Getting quotas for project 06dd1efa43b043cf84f9808305d97bf0. Resources: {'key_pairs'} {{(pid=117685) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:22:55.185383 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.quota [None req-20803fe7-9175-4eda-b4af-126f21002068 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Getting quotas for user 601782d5743c47f380358021be28cc91 and project 06dd1efa43b043cf84f9808305d97bf0. Resources: {'key_pairs'} {{(pid=117685) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:22:55.226337 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-20803fe7-9175-4eda-b4af-126f21002068 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.098270 Aug 09 11:22:55.227490 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 374/708] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 9 11:22:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:22:56.066820 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [req-b3e02ce4-a57b-43ad-835b-2f4934cb0b89 req-33737b0d-4d52-4de8-95fc-703ff63571d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "919c3009-894a-45e2-bc25-24df397fa3d0", "tag": "2572315b-325e-49c1-b65d-1b98ef984660"}]} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:22:56.080146 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-b3e02ce4-a57b-43ad-835b-2f4934cb0b89 req-33737b0d-4d52-4de8-95fc-703ff63571d8 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:56.081617 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-b3e02ce4-a57b-43ad-835b-2f4934cb0b89 req-33737b0d-4d52-4de8-95fc-703ff63571d8 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:56.082194 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-b3e02ce4-a57b-43ad-835b-2f4934cb0b89 req-33737b0d-4d52-4de8-95fc-703ff63571d8 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:56.096706 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.compute.server_external_events [req-b3e02ce4-a57b-43ad-835b-2f4934cb0b89 req-33737b0d-4d52-4de8-95fc-703ff63571d8 service nova] Creating event network-changed:2572315b-325e-49c1-b65d-1b98ef984660 for instance 919c3009-894a-45e2-bc25-24df397fa3d0 on hv-cinder-85251 Aug 09 11:22:56.104103 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [req-b3e02ce4-a57b-43ad-835b-2f4934cb0b89 req-33737b0d-4d52-4de8-95fc-703ff63571d8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043895 Aug 09 11:22:56.105038 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 335/709] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:22:56.713960 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-a8df9606-be57-4e94-9e20-1ea7ec6bb457 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6118fb56-c184-44e6-b8e5-97a95cbac9d2"}} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:22:56.717666 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-a8df9606-be57-4e94-9e20-1ea7ec6bb457 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:22:56.736767 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a8df9606-be57-4e94-9e20-1ea7ec6bb457 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:56.738928 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a8df9606-be57-4e94-9e20-1ea7ec6bb457 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:56.739393 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a8df9606-be57-4e94-9e20-1ea7ec6bb457 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:56.740677 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a8df9606-be57-4e94-9e20-1ea7ec6bb457 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:56.740677 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a8df9606-be57-4e94-9e20-1ea7ec6bb457 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:56.741027 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a8df9606-be57-4e94-9e20-1ea7ec6bb457 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:56.920091 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-eee50bf6-64e0-4a3e-986b-f7a5bae27c23 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:22:56.921080 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-eee50bf6-64e0-4a3e-986b-f7a5bae27c23 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: c883c714-443c-4df9-aaa0-8e7e81764fc2] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:22:56.939532 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-eee50bf6-64e0-4a3e-986b-f7a5bae27c23 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:56.940446 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-eee50bf6-64e0-4a3e-986b-f7a5bae27c23 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:56.950325 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-eee50bf6-64e0-4a3e-986b-f7a5bae27c23 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:56.953409 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-eee50bf6-64e0-4a3e-986b-f7a5bae27c23 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:56.955227 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-eee50bf6-64e0-4a3e-986b-f7a5bae27c23 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:56.958102 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-eee50bf6-64e0-4a3e-986b-f7a5bae27c23 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:57.039787 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-eee50bf6-64e0-4a3e-986b-f7a5bae27c23 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2/ips" status: 200 len: 150 microversion: 2.1 time: 0.118019 Aug 09 11:22:57.047158 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 336/710] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Aug 9 11:22:56 2022] GET /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2/ips => generated 150 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:22:57.197215 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-a8df9606-be57-4e94-9e20-1ea7ec6bb457 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "POST /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.487172 Aug 09 11:22:57.198706 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 375/711] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Aug 9 11:22:56 2022] POST /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078/os-volume_attachments => generated 194 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:22:58.055857 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-653e4365-3315-4842-a941-74edac21a5da tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1059406377", "imageRef": "2321e9a0-fe0f-47fd-9c4b-8868eb5a00af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f0feba9d-3263-408d-8849-6962c4d9e733"}], "security_groups": [{"name": "tempest-securitygroup--1256588831"}], "key_name": "tempest-keypair-293088370", "user_data": "}} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:22:58.218916 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.network.neutron [None req-653e4365-3315-4842-a941-74edac21a5da tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] validate_networks() for [('f0feba9d-3263-408d-8849-6962c4d9e733', None, None, None, None, None)] {{(pid=117684) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 11:22:58.678920 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-653e4365-3315-4842-a941-74edac21a5da tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Flavor limits 0:0:0 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 11:22:58.679368 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-653e4365-3315-4842-a941-74edac21a5da tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Image limits 0:0:0 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 11:22:58.679845 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-653e4365-3315-4842-a941-74edac21a5da tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Flavor pref 0:0:0 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 11:22:58.680253 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-653e4365-3315-4842-a941-74edac21a5da tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Image pref 0:0:0 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 11:22:58.680801 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-653e4365-3315-4842-a941-74edac21a5da tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 11:22:58.690832 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-653e4365-3315-4842-a941-74edac21a5da tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:58.691392 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-653e4365-3315-4842-a941-74edac21a5da tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:58.691831 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-653e4365-3315-4842-a941-74edac21a5da tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:58.692588 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-653e4365-3315-4842-a941-74edac21a5da tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:58.693041 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-653e4365-3315-4842-a941-74edac21a5da tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:58.693463 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-653e4365-3315-4842-a941-74edac21a5da tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:58.702073 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-f3d6482c-f097-436c-b0f5-7f9232834696 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "74449c2e-2b22-4355-8243-fb5135376533"}} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:22:58.704773 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-f3d6482c-f097-436c-b0f5-7f9232834696 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: c883c714-443c-4df9-aaa0-8e7e81764fc2] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:22:58.711082 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f3d6482c-f097-436c-b0f5-7f9232834696 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:58.711310 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.quota [None req-653e4365-3315-4842-a941-74edac21a5da tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Getting quotas for project 06dd1efa43b043cf84f9808305d97bf0. Resources: {'cores', 'instances', 'ram'} {{(pid=117684) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:22:58.711708 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f3d6482c-f097-436c-b0f5-7f9232834696 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:58.712236 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f3d6482c-f097-436c-b0f5-7f9232834696 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:58.713168 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f3d6482c-f097-436c-b0f5-7f9232834696 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:58.713836 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f3d6482c-f097-436c-b0f5-7f9232834696 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:58.714360 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f3d6482c-f097-436c-b0f5-7f9232834696 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:58.717005 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.quota [None req-653e4365-3315-4842-a941-74edac21a5da tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Getting quotas for user 601782d5743c47f380358021be28cc91 and project 06dd1efa43b043cf84f9808305d97bf0. Resources: {'cores', 'instances', 'ram'} {{(pid=117684) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:22:58.730758 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-653e4365-3315-4842-a941-74edac21a5da tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Going to run 1 instances... {{(pid=117684) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 11:22:58.733799 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-653e4365-3315-4842-a941-74edac21a5da tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: 6c6b7435-b965-416a-ae82-7eb037cc7152] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2321e9a0-fe0f-47fd-9c4b-8868eb5a00af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117684) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 11:22:58.816117 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-653e4365-3315-4842-a941-74edac21a5da tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.768184 Aug 09 11:22:58.817539 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 337/712] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 9 11:22:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 11:22:58.836315 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-9b4dba5a-90cf-4cf3-aef8-d1c8e47a418d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:22:58.837895 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-9b4dba5a-90cf-4cf3-aef8-d1c8e47a418d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: 6c6b7435-b965-416a-ae82-7eb037cc7152] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:22:58.923346 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-9b4dba5a-90cf-4cf3-aef8-d1c8e47a418d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:22:58.931976 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-9b4dba5a-90cf-4cf3-aef8-d1c8e47a418d tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152" status: 200 len: 1237 microversion: 2.1 time: 0.107025 Aug 09 11:22:58.933128 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 338/713] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:22:58 2022] GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152 => generated 1237 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:22:59.062269 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-f3d6482c-f097-436c-b0f5-7f9232834696 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "POST /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.364973 Aug 09 11:22:59.062951 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 376/714] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Aug 9 11:22:58 2022] POST /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2/os-volume_attachments => generated 194 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:22:59.955339 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-df42a18d-1f79-496a-b7c3-6a5045b61adc tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:22:59.956894 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-df42a18d-1f79-496a-b7c3-6a5045b61adc tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: 6c6b7435-b965-416a-ae82-7eb037cc7152] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:22:59.967707 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-df42a18d-1f79-496a-b7c3-6a5045b61adc tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:59.968617 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-df42a18d-1f79-496a-b7c3-6a5045b61adc tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:59.969281 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-df42a18d-1f79-496a-b7c3-6a5045b61adc tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:22:59.970291 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-df42a18d-1f79-496a-b7c3-6a5045b61adc tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:22:59.970970 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-df42a18d-1f79-496a-b7c3-6a5045b61adc tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:22:59.971594 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-df42a18d-1f79-496a-b7c3-6a5045b61adc tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:00.072041 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-df42a18d-1f79-496a-b7c3-6a5045b61adc tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:00.091754 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-df42a18d-1f79-496a-b7c3-6a5045b61adc tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152" status: 200 len: 1297 microversion: 2.1 time: 0.135701 Aug 09 11:23:00.106269 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 339/715] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:22:59 2022] GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152 => generated 1297 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:01.115389 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-e8ad1fc4-5dbd-4388-ace9-4767e7ce1d11 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:01.118400 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-e8ad1fc4-5dbd-4388-ace9-4767e7ce1d11 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: 6c6b7435-b965-416a-ae82-7eb037cc7152] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:01.127649 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e8ad1fc4-5dbd-4388-ace9-4767e7ce1d11 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:01.128141 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e8ad1fc4-5dbd-4388-ace9-4767e7ce1d11 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:01.128782 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e8ad1fc4-5dbd-4388-ace9-4767e7ce1d11 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:01.129649 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e8ad1fc4-5dbd-4388-ace9-4767e7ce1d11 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:01.130240 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e8ad1fc4-5dbd-4388-ace9-4767e7ce1d11 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:01.130828 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e8ad1fc4-5dbd-4388-ace9-4767e7ce1d11 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:01.284983 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-e8ad1fc4-5dbd-4388-ace9-4767e7ce1d11 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:01.300433 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-e8ad1fc4-5dbd-4388-ace9-4767e7ce1d11 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152" status: 200 len: 1295 microversion: 2.1 time: 0.190188 Aug 09 11:23:01.308336 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 377/716] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:01 2022] GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152 => generated 1295 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:02.328724 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-020e2969-5f22-45b8-b96c-98cc6f13914f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:02.329444 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-020e2969-5f22-45b8-b96c-98cc6f13914f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: 6c6b7435-b965-416a-ae82-7eb037cc7152] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:02.339482 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-020e2969-5f22-45b8-b96c-98cc6f13914f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:02.339969 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-020e2969-5f22-45b8-b96c-98cc6f13914f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:02.340429 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-020e2969-5f22-45b8-b96c-98cc6f13914f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:02.341732 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-020e2969-5f22-45b8-b96c-98cc6f13914f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:02.342367 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-020e2969-5f22-45b8-b96c-98cc6f13914f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:02.342970 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-020e2969-5f22-45b8-b96c-98cc6f13914f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:02.502761 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-020e2969-5f22-45b8-b96c-98cc6f13914f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:02.514936 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-020e2969-5f22-45b8-b96c-98cc6f13914f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152" status: 200 len: 1363 microversion: 2.1 time: 0.189955 Aug 09 11:23:02.515526 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 340/717] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:02 2022] GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152 => generated 1363 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:03.097832 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-b62ccf2a-e9eb-4697-ad8c-d2b933edd253 req-1298b2a4-b5db-4b66-acda-2c6bd537911c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c6b7435-b965-416a-ae82-7eb037cc7152", "tag": "42ae7264-9701-4213-88ec-bfd261319ae9"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:23:03.115827 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-b62ccf2a-e9eb-4697-ad8c-d2b933edd253 req-1298b2a4-b5db-4b66-acda-2c6bd537911c service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:03.116348 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-b62ccf2a-e9eb-4697-ad8c-d2b933edd253 req-1298b2a4-b5db-4b66-acda-2c6bd537911c service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:03.116979 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-b62ccf2a-e9eb-4697-ad8c-d2b933edd253 req-1298b2a4-b5db-4b66-acda-2c6bd537911c service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:03.134563 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-b62ccf2a-e9eb-4697-ad8c-d2b933edd253 req-1298b2a4-b5db-4b66-acda-2c6bd537911c service nova] Creating event network-changed:42ae7264-9701-4213-88ec-bfd261319ae9 for instance 6c6b7435-b965-416a-ae82-7eb037cc7152 on hv-cinder-85251 Aug 09 11:23:03.140282 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-b62ccf2a-e9eb-4697-ad8c-d2b933edd253 req-1298b2a4-b5db-4b66-acda-2c6bd537911c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046586 Aug 09 11:23:03.141937 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 378/718] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:23:03.537449 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-90f78408-9179-4ae8-8db0-e848bff1afc0 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:03.538123 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-90f78408-9179-4ae8-8db0-e848bff1afc0 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: 6c6b7435-b965-416a-ae82-7eb037cc7152] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:03.545415 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-90f78408-9179-4ae8-8db0-e848bff1afc0 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:03.546060 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-90f78408-9179-4ae8-8db0-e848bff1afc0 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:03.546495 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-90f78408-9179-4ae8-8db0-e848bff1afc0 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:03.547209 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-90f78408-9179-4ae8-8db0-e848bff1afc0 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:03.547754 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-90f78408-9179-4ae8-8db0-e848bff1afc0 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:03.548891 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-90f78408-9179-4ae8-8db0-e848bff1afc0 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:03.837035 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-90f78408-9179-4ae8-8db0-e848bff1afc0 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:03.853216 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-90f78408-9179-4ae8-8db0-e848bff1afc0 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152" status: 200 len: 1363 microversion: 2.1 time: 0.320702 Aug 09 11:23:03.853948 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 341/719] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:03 2022] GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152 => generated 1363 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:04.877028 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-3c6f0b76-31a1-4e4b-8ba3-e7dea7b766b3 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:04.877858 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-3c6f0b76-31a1-4e4b-8ba3-e7dea7b766b3 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: 6c6b7435-b965-416a-ae82-7eb037cc7152] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:04.885870 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3c6f0b76-31a1-4e4b-8ba3-e7dea7b766b3 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:04.886357 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3c6f0b76-31a1-4e4b-8ba3-e7dea7b766b3 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:04.886817 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3c6f0b76-31a1-4e4b-8ba3-e7dea7b766b3 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:04.887522 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3c6f0b76-31a1-4e4b-8ba3-e7dea7b766b3 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:04.887967 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3c6f0b76-31a1-4e4b-8ba3-e7dea7b766b3 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:04.890703 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3c6f0b76-31a1-4e4b-8ba3-e7dea7b766b3 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:05.089915 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-ac1a4e17-6cc8-4147-b712-3b6e4eb478c1 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:23:05.092395 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-ac1a4e17-6cc8-4147-b712-3b6e4eb478c1 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:05.100720 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ac1a4e17-6cc8-4147-b712-3b6e4eb478c1 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:05.102886 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ac1a4e17-6cc8-4147-b712-3b6e4eb478c1 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:05.103525 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ac1a4e17-6cc8-4147-b712-3b6e4eb478c1 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:05.104492 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ac1a4e17-6cc8-4147-b712-3b6e4eb478c1 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:05.105109 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ac1a4e17-6cc8-4147-b712-3b6e4eb478c1 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:05.105684 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ac1a4e17-6cc8-4147-b712-3b6e4eb478c1 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:05.136885 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.objects.instance [None req-ac1a4e17-6cc8-4147-b712-3b6e4eb478c1 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lazy-loading 'flavor' on Instance uuid 8009a1a2-4c8e-4953-ba5c-faab2db05078 {{(pid=117684) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:23:05.185694 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-3c6f0b76-31a1-4e4b-8ba3-e7dea7b766b3 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:05.194595 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-3c6f0b76-31a1-4e4b-8ba3-e7dea7b766b3 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152" status: 200 len: 1363 microversion: 2.1 time: 0.322258 Aug 09 11:23:05.195943 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 379/720] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:04 2022] GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152 => generated 1363 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:05.309578 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-ac1a4e17-6cc8-4147-b712-3b6e4eb478c1 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "POST /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078/action" status: 200 len: 32 microversion: 2.1 time: 0.224137 Aug 09 11:23:05.310716 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 342/721] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 9 11:23:05 2022] POST /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078/action => generated 32 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 09 11:23:05.320628 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-ec5e267c-75a1-4e70-84ea-161da6ed5185 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:05.321403 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-ec5e267c-75a1-4e70-84ea-161da6ed5185 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:05.324508 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell0:SELECT=4 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:23:05.327979 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ec5e267c-75a1-4e70-84ea-161da6ed5185 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:05.328487 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ec5e267c-75a1-4e70-84ea-161da6ed5185 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:05.329002 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ec5e267c-75a1-4e70-84ea-161da6ed5185 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:05.329719 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ec5e267c-75a1-4e70-84ea-161da6ed5185 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:05.330424 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ec5e267c-75a1-4e70-84ea-161da6ed5185 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:05.330845 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ec5e267c-75a1-4e70-84ea-161da6ed5185 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:05.535351 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-ec5e267c-75a1-4e70-84ea-161da6ed5185 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:05.558072 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-ec5e267c-75a1-4e70-84ea-161da6ed5185 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078" status: 200 len: 1734 microversion: 2.1 time: 0.241100 Aug 09 11:23:05.563423 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 380/722] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:05 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 => generated 1734 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:05.730248 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-09bc749e-f888-464b-b427-3e043d534740 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Action: 'create', calling method: .version_select at 0x7f282205bdc0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1024053701", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMwvtjjvmjy3OaidvV9xs9PIR5jTqajw8Q0O4p/jq705CjQ18AVlr1RVtW6PLTUtuGb1W0hVJraFhJdMtYA5UN6XoFlRswM9azGknoPJZi2oiMZQcO7yj2732bgl58uWyQ=="}} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:23:05.765387 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.quota [None req-09bc749e-f888-464b-b427-3e043d534740 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Getting quotas for project bfd671fcff7e4b24b5415a3a1b70ad0f. Resources: {'key_pairs'} {{(pid=117684) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:23:05.772569 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.quota [None req-09bc749e-f888-464b-b427-3e043d534740 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Getting quotas for user 5b4c4030b5fb4381a598a54588880b75 and project bfd671fcff7e4b24b5415a3a1b70ad0f. Resources: {'key_pairs'} {{(pid=117684) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:23:05.803021 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-09bc749e-f888-464b-b427-3e043d534740 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.290194 Aug 09 11:23:05.803950 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 343/723] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 9 11:23:05 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:23:06.217618 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-2faed179-4b89-45e6-9994-ea4835a13ff6 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:06.218459 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-2faed179-4b89-45e6-9994-ea4835a13ff6 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: 6c6b7435-b965-416a-ae82-7eb037cc7152] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:06.226733 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2faed179-4b89-45e6-9994-ea4835a13ff6 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:06.227358 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2faed179-4b89-45e6-9994-ea4835a13ff6 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:06.227861 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2faed179-4b89-45e6-9994-ea4835a13ff6 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:06.228813 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2faed179-4b89-45e6-9994-ea4835a13ff6 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:06.229525 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2faed179-4b89-45e6-9994-ea4835a13ff6 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:06.230101 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2faed179-4b89-45e6-9994-ea4835a13ff6 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:06.396413 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-2faed179-4b89-45e6-9994-ea4835a13ff6 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:06.404318 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-2faed179-4b89-45e6-9994-ea4835a13ff6 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152" status: 200 len: 1363 microversion: 2.1 time: 0.191681 Aug 09 11:23:06.405452 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 381/724] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:06 2022] GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152 => generated 1363 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:06.583878 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-01160596-49ef-4192-b4cc-53e0fb97b1fd tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:06.584829 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-01160596-49ef-4192-b4cc-53e0fb97b1fd tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:06.593602 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-01160596-49ef-4192-b4cc-53e0fb97b1fd tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:06.594334 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-01160596-49ef-4192-b4cc-53e0fb97b1fd tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:06.595049 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-01160596-49ef-4192-b4cc-53e0fb97b1fd tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:06.595965 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-01160596-49ef-4192-b4cc-53e0fb97b1fd tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:06.596427 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-01160596-49ef-4192-b4cc-53e0fb97b1fd tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:06.597039 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-01160596-49ef-4192-b4cc-53e0fb97b1fd tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:06.739170 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-01160596-49ef-4192-b4cc-53e0fb97b1fd tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:06.748707 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-01160596-49ef-4192-b4cc-53e0fb97b1fd tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078" status: 200 len: 1734 microversion: 2.1 time: 0.169119 Aug 09 11:23:06.749356 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 344/725] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:06 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:07.439517 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-f8b5c732-228d-4d79-962f-dd9f2d0c169b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:07.440131 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-f8b5c732-228d-4d79-962f-dd9f2d0c169b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: 6c6b7435-b965-416a-ae82-7eb037cc7152] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:07.446579 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f8b5c732-228d-4d79-962f-dd9f2d0c169b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:07.447065 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f8b5c732-228d-4d79-962f-dd9f2d0c169b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:07.447498 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f8b5c732-228d-4d79-962f-dd9f2d0c169b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:07.448243 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f8b5c732-228d-4d79-962f-dd9f2d0c169b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:07.448671 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f8b5c732-228d-4d79-962f-dd9f2d0c169b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:07.449094 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f8b5c732-228d-4d79-962f-dd9f2d0c169b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:07.585877 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-f8b5c732-228d-4d79-962f-dd9f2d0c169b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:07.594258 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-f8b5c732-228d-4d79-962f-dd9f2d0c169b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152" status: 200 len: 1363 microversion: 2.1 time: 0.158966 Aug 09 11:23:07.595428 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 382/726] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:07 2022] GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:07.770510 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-2026699f-1c58-4b27-8876-1f3e54a6ff3f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:07.771709 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-2026699f-1c58-4b27-8876-1f3e54a6ff3f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:07.778556 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2026699f-1c58-4b27-8876-1f3e54a6ff3f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:07.779019 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2026699f-1c58-4b27-8876-1f3e54a6ff3f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:07.779451 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2026699f-1c58-4b27-8876-1f3e54a6ff3f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:07.780171 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2026699f-1c58-4b27-8876-1f3e54a6ff3f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:07.780672 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2026699f-1c58-4b27-8876-1f3e54a6ff3f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:07.781094 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2026699f-1c58-4b27-8876-1f3e54a6ff3f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:07.933108 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-2026699f-1c58-4b27-8876-1f3e54a6ff3f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:07.941907 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-2026699f-1c58-4b27-8876-1f3e54a6ff3f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078" status: 200 len: 1734 microversion: 2.1 time: 0.175526 Aug 09 11:23:07.942489 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 345/727] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:07 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 => generated 1734 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:08.615527 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-c0c7d039-b70e-4380-9ef9-0e3b25b4e71e tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:08.616171 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-c0c7d039-b70e-4380-9ef9-0e3b25b4e71e tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: 6c6b7435-b965-416a-ae82-7eb037cc7152] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:08.622834 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c0c7d039-b70e-4380-9ef9-0e3b25b4e71e tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:08.623325 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c0c7d039-b70e-4380-9ef9-0e3b25b4e71e tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:08.623759 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c0c7d039-b70e-4380-9ef9-0e3b25b4e71e tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:08.624623 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c0c7d039-b70e-4380-9ef9-0e3b25b4e71e tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:08.625062 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c0c7d039-b70e-4380-9ef9-0e3b25b4e71e tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:08.625487 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c0c7d039-b70e-4380-9ef9-0e3b25b4e71e tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:08.764129 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-c0c7d039-b70e-4380-9ef9-0e3b25b4e71e tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:08.773089 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-c0c7d039-b70e-4380-9ef9-0e3b25b4e71e tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152" status: 200 len: 1363 microversion: 2.1 time: 0.161609 Aug 09 11:23:08.773743 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 383/728] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:08 2022] GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:08.963010 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-18414b50-0d19-436f-8a53-b81de5b85071 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:08.963659 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-18414b50-0d19-436f-8a53-b81de5b85071 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:08.965687 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell0:SELECT=2 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:23:08.971239 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-18414b50-0d19-436f-8a53-b81de5b85071 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:08.971728 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-18414b50-0d19-436f-8a53-b81de5b85071 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:08.972164 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-18414b50-0d19-436f-8a53-b81de5b85071 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:08.973454 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-18414b50-0d19-436f-8a53-b81de5b85071 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:08.973712 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-18414b50-0d19-436f-8a53-b81de5b85071 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:08.974204 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-18414b50-0d19-436f-8a53-b81de5b85071 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:09.117128 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-18414b50-0d19-436f-8a53-b81de5b85071 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:09.125570 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-18414b50-0d19-436f-8a53-b81de5b85071 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078" status: 200 len: 1734 microversion: 2.1 time: 0.166571 Aug 09 11:23:09.126764 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 346/729] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:08 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:09.702070 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-bd0b726d-192b-4dd2-a037-881ec895653f req-1dbeec20-4ca4-4278-892d-a0558af01764 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c6b7435-b965-416a-ae82-7eb037cc7152", "name": "network-vif-plugged", "status": "completed", "tag": "42ae7264-9701-4213-88ec-bfd261319ae9"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:23:09.712621 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-bd0b726d-192b-4dd2-a037-881ec895653f req-1dbeec20-4ca4-4278-892d-a0558af01764 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:09.714008 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-bd0b726d-192b-4dd2-a037-881ec895653f req-1dbeec20-4ca4-4278-892d-a0558af01764 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:09.714614 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-bd0b726d-192b-4dd2-a037-881ec895653f req-1dbeec20-4ca4-4278-892d-a0558af01764 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:09.733585 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:23:09.736689 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-bd0b726d-192b-4dd2-a037-881ec895653f req-1dbeec20-4ca4-4278-892d-a0558af01764 service nova] Creating event network-vif-plugged:42ae7264-9701-4213-88ec-bfd261319ae9 for instance 6c6b7435-b965-416a-ae82-7eb037cc7152 on hv-cinder-85251 Aug 09 11:23:09.741678 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-bd0b726d-192b-4dd2-a037-881ec895653f req-1dbeec20-4ca4-4278-892d-a0558af01764 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043310 Aug 09 11:23:09.742497 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 384/730] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:23:09.793728 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-09d5620d-8d86-42bd-8947-940317165f77 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:09.794362 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-09d5620d-8d86-42bd-8947-940317165f77 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: 6c6b7435-b965-416a-ae82-7eb037cc7152] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:09.800756 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-09d5620d-8d86-42bd-8947-940317165f77 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:09.801358 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-09d5620d-8d86-42bd-8947-940317165f77 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:09.801795 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-09d5620d-8d86-42bd-8947-940317165f77 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:09.802509 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-09d5620d-8d86-42bd-8947-940317165f77 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:09.802955 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-09d5620d-8d86-42bd-8947-940317165f77 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:09.803438 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-09d5620d-8d86-42bd-8947-940317165f77 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:10.002154 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-09d5620d-8d86-42bd-8947-940317165f77 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:10.010173 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-09d5620d-8d86-42bd-8947-940317165f77 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152" status: 200 len: 1363 microversion: 2.1 time: 0.220340 Aug 09 11:23:10.010759 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 347/731] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:09 2022] GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152 => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:10.148530 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-275f968a-61bd-45f3-a4e8-c9df0dbc07a9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:10.149543 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-275f968a-61bd-45f3-a4e8-c9df0dbc07a9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:10.157489 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-275f968a-61bd-45f3-a4e8-c9df0dbc07a9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:10.158378 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-275f968a-61bd-45f3-a4e8-c9df0dbc07a9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:10.158820 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-275f968a-61bd-45f3-a4e8-c9df0dbc07a9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:10.159536 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-275f968a-61bd-45f3-a4e8-c9df0dbc07a9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:10.160015 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-275f968a-61bd-45f3-a4e8-c9df0dbc07a9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:10.160486 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-275f968a-61bd-45f3-a4e8-c9df0dbc07a9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:10.320817 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-275f968a-61bd-45f3-a4e8-c9df0dbc07a9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:10.329697 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-275f968a-61bd-45f3-a4e8-c9df0dbc07a9 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078" status: 200 len: 1734 microversion: 2.1 time: 0.186061 Aug 09 11:23:10.330290 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 385/732] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:10 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 => generated 1734 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:11.033096 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-5240df3d-06b0-42ce-bdfe-cd1e5f769311 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:11.033700 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-5240df3d-06b0-42ce-bdfe-cd1e5f769311 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: 6c6b7435-b965-416a-ae82-7eb037cc7152] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:11.040810 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5240df3d-06b0-42ce-bdfe-cd1e5f769311 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:11.041275 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5240df3d-06b0-42ce-bdfe-cd1e5f769311 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:11.041726 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5240df3d-06b0-42ce-bdfe-cd1e5f769311 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:11.042427 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5240df3d-06b0-42ce-bdfe-cd1e5f769311 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:11.042869 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5240df3d-06b0-42ce-bdfe-cd1e5f769311 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:11.043290 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5240df3d-06b0-42ce-bdfe-cd1e5f769311 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:11.183168 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-5240df3d-06b0-42ce-bdfe-cd1e5f769311 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:11.193830 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-5240df3d-06b0-42ce-bdfe-cd1e5f769311 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152" status: 200 len: 1363 microversion: 2.1 time: 0.165099 Aug 09 11:23:11.198331 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 348/733] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:11 2022] GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:11.352418 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-68f3efb8-c3b6-49e8-898b-2beca4474730 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:11.353041 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-68f3efb8-c3b6-49e8-898b-2beca4474730 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:11.359297 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-68f3efb8-c3b6-49e8-898b-2beca4474730 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:11.359760 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-68f3efb8-c3b6-49e8-898b-2beca4474730 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:11.360341 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-68f3efb8-c3b6-49e8-898b-2beca4474730 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:11.361126 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-68f3efb8-c3b6-49e8-898b-2beca4474730 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:11.361583 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-68f3efb8-c3b6-49e8-898b-2beca4474730 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:11.362009 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-68f3efb8-c3b6-49e8-898b-2beca4474730 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:11.511384 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-68f3efb8-c3b6-49e8-898b-2beca4474730 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:11.523042 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-68f3efb8-c3b6-49e8-898b-2beca4474730 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078" status: 200 len: 1734 microversion: 2.1 time: 0.175323 Aug 09 11:23:11.524395 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 386/734] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:11 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 => generated 1734 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:12.216685 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-2fcc4642-0305-4e56-be2a-019970404a44 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:12.217306 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-2fcc4642-0305-4e56-be2a-019970404a44 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: 6c6b7435-b965-416a-ae82-7eb037cc7152] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:12.223569 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2fcc4642-0305-4e56-be2a-019970404a44 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:12.224058 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2fcc4642-0305-4e56-be2a-019970404a44 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:12.224544 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2fcc4642-0305-4e56-be2a-019970404a44 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:12.225994 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2fcc4642-0305-4e56-be2a-019970404a44 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:12.226442 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2fcc4642-0305-4e56-be2a-019970404a44 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:12.226861 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2fcc4642-0305-4e56-be2a-019970404a44 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:12.371910 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-2fcc4642-0305-4e56-be2a-019970404a44 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:12.381132 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-2fcc4642-0305-4e56-be2a-019970404a44 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152" status: 200 len: 1550 microversion: 2.1 time: 0.168501 Aug 09 11:23:12.382400 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 349/735] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:12 2022] GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152 => generated 1550 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:12.402334 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-e76b91db-57c1-4dfe-9090-6a791ff842af tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:12.403063 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-e76b91db-57c1-4dfe-9090-6a791ff842af tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: 6c6b7435-b965-416a-ae82-7eb037cc7152] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:12.409982 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e76b91db-57c1-4dfe-9090-6a791ff842af tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:12.410702 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e76b91db-57c1-4dfe-9090-6a791ff842af tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:12.411122 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e76b91db-57c1-4dfe-9090-6a791ff842af tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:12.412042 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e76b91db-57c1-4dfe-9090-6a791ff842af tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:12.412525 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e76b91db-57c1-4dfe-9090-6a791ff842af tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:12.412942 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e76b91db-57c1-4dfe-9090-6a791ff842af tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:12.498263 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-e76b91db-57c1-4dfe-9090-6a791ff842af tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099689 Aug 09 11:23:12.498922 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 387/736] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Aug 9 11:23:12 2022] GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:23:12.546098 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-3b53ff23-764c-4a99-992f-2ffae66d4c87 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:12.546830 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-3b53ff23-764c-4a99-992f-2ffae66d4c87 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:12.554210 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3b53ff23-764c-4a99-992f-2ffae66d4c87 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:12.554711 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3b53ff23-764c-4a99-992f-2ffae66d4c87 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:12.555152 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3b53ff23-764c-4a99-992f-2ffae66d4c87 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:12.555871 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3b53ff23-764c-4a99-992f-2ffae66d4c87 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:12.556347 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3b53ff23-764c-4a99-992f-2ffae66d4c87 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:12.556780 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3b53ff23-764c-4a99-992f-2ffae66d4c87 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:12.561271 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:23:12.705990 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-3b53ff23-764c-4a99-992f-2ffae66d4c87 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:12.714761 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-3b53ff23-764c-4a99-992f-2ffae66d4c87 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078" status: 200 len: 1734 microversion: 2.1 time: 0.172740 Aug 09 11:23:12.728600 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 350/737] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:12 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 => generated 1734 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:13.257547 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-3f628d45-80c4-43dd-be94-3a25340fe531 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "74449c2e-2b22-4355-8243-fb5135376533"}} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:23:13.259903 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-3f628d45-80c4-43dd-be94-3a25340fe531 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: c883c714-443c-4df9-aaa0-8e7e81764fc2] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:13.266106 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3f628d45-80c4-43dd-be94-3a25340fe531 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:13.266590 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3f628d45-80c4-43dd-be94-3a25340fe531 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:13.267023 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3f628d45-80c4-43dd-be94-3a25340fe531 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:13.267726 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3f628d45-80c4-43dd-be94-3a25340fe531 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:13.268176 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3f628d45-80c4-43dd-be94-3a25340fe531 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:13.268625 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3f628d45-80c4-43dd-be94-3a25340fe531 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:13.352459 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.wsgi [None req-3f628d45-80c4-43dd-be94-3a25340fe531 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] HTTP exception thrown: Invalid volume: volume 74449c2e-2b22-4355-8243-fb5135376533 is already attached to instances: c883c714-443c-4df9-aaa0-8e7e81764fc2 Aug 09 11:23:13.354220 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-3f628d45-80c4-43dd-be94-3a25340fe531 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Request method failure captured: Aug 09 11:23:13.354220 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: request: POST /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2/os-volume_attachments HTTP/1.1 Aug 09 11:23:13.354220 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Accept: application/json Aug 09 11:23:13.354220 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Accept-Encoding: identity Aug 09 11:23:13.354220 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Connection: close Aug 09 11:23:13.354220 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Content-Length: 74 Aug 09 11:23:13.354220 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Content-Type: application/json Aug 09 11:23:13.354220 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Host: 10.222.0.27 Aug 09 11:23:13.354220 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Openstack-System-Scope: None Aug 09 11:23:13.354220 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: User-Agent: python-urllib3/1.26.11 Aug 09 11:23:13.354220 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Auth-Token: gAAAAABi8kJrkCuZ0ZtlZIUmAC-EK2I0okp8exzRXbUBoHrpFGaG17TfS3kn4sSvkBzyMOMoCBQBmvOs9UrhF5xw2U46aP5Pxlq5Kj8piUuPsDzn7s8ETM_3P18gyColYBDIhcjSMUGohuoeVN3S8QIKYIofZURyiH1QY4Vi6NWdxWuymPkih0k Aug 09 11:23:13.354220 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Domain-Id: None Aug 09 11:23:13.354220 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Domain-Name: None Aug 09 11:23:13.354220 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Identity-Status: Confirmed Aug 09 11:23:13.354220 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Is-Admin-Project: True Aug 09 11:23:13.354220 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Domain-Id: default Aug 09 11:23:13.354220 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Domain-Name: Default Aug 09 11:23:13.354220 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Id: cba1dd0b689b4fff847b6fd3787b143c Aug 09 11:23:13.354220 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Name: tempest-AttachVolumeNegativeTest-1410930012 Aug 09 11:23:13.354220 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Role: member,reader Aug 09 11:23:13.354220 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Roles: member,reader Aug 09 11:23:13.356189 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:23:13.356189 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant: tempest-AttachVolumeNegativeTest-1410930012 Aug 09 11:23:13.356189 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant-Id: cba1dd0b689b4fff847b6fd3787b143c Aug 09 11:23:13.356189 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1410930012 Aug 09 11:23:13.356189 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User: tempest-AttachVolumeNegativeTest-1410930012-project Aug 09 11:23:13.356189 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Domain-Id: default Aug 09 11:23:13.356189 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Domain-Name: Default Aug 09 11:23:13.356189 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Id: f4da6dd860bb45d1a703a18c2512ffe4 Aug 09 11:23:13.356189 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Name: tempest-AttachVolumeNegativeTest-1410930012-project Aug 09 11:23:13.356189 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Aug 09 11:23:13.356189 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: {"volumeAttachment": {"volumeId": "74449c2e-2b22-4355-8243-fb5135376533"}} Aug 09 11:23:13.356189 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: method: > Aug 09 11:23:13.357056 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: exception: Invalid volume: volume 74449c2e-2b22-4355-8243-fb5135376533 is already attached to instances: c883c714-443c-4df9-aaa0-8e7e81764fc2 Aug 09 11:23:13.357056 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: action_args: {'server_id': 'c883c714-443c-4df9-aaa0-8e7e81764fc2', 'body': {'volumeAttachment': {'volumeId': '74449c2e-2b22-4355-8243-fb5135376533'}}} Aug 09 11:23:13.357056 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:23:13.357056 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:23:13.357056 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 09 11:23:13.357056 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 09 11:23:13.357056 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 11:23:13.357056 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 11:23:13.357056 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 09 11:23:13.357056 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 11:23:13.357056 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 09 11:23:13.357056 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 09 11:23:13.357056 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 09 11:23:13.357056 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 09 11:23:13.357056 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 74449c2e-2b22-4355-8243-fb5135376533 is already attached to instances: c883c714-443c-4df9-aaa0-8e7e81764fc2 Aug 09 11:23:13.357056 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:23:13.357056 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:23:13.357056 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:23:13.357056 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:23:13.358724 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:23:13.358724 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:23:13.358724 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:23:13.358724 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:23:13.358724 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:23:13.358724 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:23:13.358724 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 11:23:13.358724 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 11:23:13.358724 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 11:23:13.358724 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 11:23:13.358724 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 11:23:13.358724 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 11:23:13.358724 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 09 11:23:13.358724 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 09 11:23:13.358724 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 74449c2e-2b22-4355-8243-fb5135376533 is already attached to instances: c883c714-443c-4df9-aaa0-8e7e81764fc2 Aug 09 11:23:13.358724 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:23:13.358724 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:23:13.358724 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:23:13.358724 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:23:13.358724 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:23:13.359960 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:23:13.359960 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:23:13.359960 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:23:13.359960 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 74449c2e-2b22-4355-8243-fb5135376533 is already attached to instances: c883c714-443c-4df9-aaa0-8e7e81764fc2 Aug 09 11:23:13.359960 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:23:13.359960 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-3f628d45-80c4-43dd-be94-3a25340fe531 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Returning 400 to user: Invalid volume: volume 74449c2e-2b22-4355-8243-fb5135376533 is already attached to instances: c883c714-443c-4df9-aaa0-8e7e81764fc2 {{(pid=117685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:23:13.359960 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-3f628d45-80c4-43dd-be94-3a25340fe531 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "POST /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102373 Aug 09 11:23:13.361275 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 388/738] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Aug 9 11:23:13 2022] POST /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 11:23:13.422014 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-9bd23f27-f9bf-4fd2-96aa-fd7669defae7 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:13.422646 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-9bd23f27-f9bf-4fd2-96aa-fd7669defae7 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: c883c714-443c-4df9-aaa0-8e7e81764fc2] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:13.428987 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9bd23f27-f9bf-4fd2-96aa-fd7669defae7 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:13.429468 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9bd23f27-f9bf-4fd2-96aa-fd7669defae7 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:13.429871 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9bd23f27-f9bf-4fd2-96aa-fd7669defae7 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:13.430551 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9bd23f27-f9bf-4fd2-96aa-fd7669defae7 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:13.430992 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9bd23f27-f9bf-4fd2-96aa-fd7669defae7 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:13.431523 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9bd23f27-f9bf-4fd2-96aa-fd7669defae7 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:13.523098 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-c2e68711-bf91-4f47-bd79-a43fa8b7cff8 req-90d144ac-8f99-4d86-b545-40e9360ebf25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c6b7435-b965-416a-ae82-7eb037cc7152", "tag": "42ae7264-9701-4213-88ec-bfd261319ae9"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:23:13.523738 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.objects.instance [None req-9bd23f27-f9bf-4fd2-96aa-fd7669defae7 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lazy-loading 'services' on Instance uuid c883c714-443c-4df9-aaa0-8e7e81764fc2 {{(pid=117684) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:23:13.534483 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-c2e68711-bf91-4f47-bd79-a43fa8b7cff8 req-90d144ac-8f99-4d86-b545-40e9360ebf25 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:13.535044 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-c2e68711-bf91-4f47-bd79-a43fa8b7cff8 req-90d144ac-8f99-4d86-b545-40e9360ebf25 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:13.535798 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-c2e68711-bf91-4f47-bd79-a43fa8b7cff8 req-90d144ac-8f99-4d86-b545-40e9360ebf25 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:13.555571 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-c2e68711-bf91-4f47-bd79-a43fa8b7cff8 req-90d144ac-8f99-4d86-b545-40e9360ebf25 service nova] Creating event network-changed:42ae7264-9701-4213-88ec-bfd261319ae9 for instance 6c6b7435-b965-416a-ae82-7eb037cc7152 on hv-cinder-85251 Aug 09 11:23:13.560873 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-c2e68711-bf91-4f47-bd79-a43fa8b7cff8 req-90d144ac-8f99-4d86-b545-40e9360ebf25 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042747 Aug 09 11:23:13.561477 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 389/739] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:23:13.607368 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-9bd23f27-f9bf-4fd2-96aa-fd7669defae7 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2/os-volume_attachments/74449c2e-2b22-4355-8243-fb5135376533" status: 202 len: 0 microversion: 2.1 time: 0.189350 Aug 09 11:23:13.608058 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 351/740] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Aug 9 11:23:13 2022] DELETE /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2/os-volume_attachments/74449c2e-2b22-4355-8243-fb5135376533 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:23:13.618011 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-bfe5bc39-a826-4cb4-ba4b-1b67dc59a312 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:13.621682 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-bfe5bc39-a826-4cb4-ba4b-1b67dc59a312 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: c883c714-443c-4df9-aaa0-8e7e81764fc2] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:13.629675 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bfe5bc39-a826-4cb4-ba4b-1b67dc59a312 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:13.630335 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bfe5bc39-a826-4cb4-ba4b-1b67dc59a312 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:13.630809 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bfe5bc39-a826-4cb4-ba4b-1b67dc59a312 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:13.631787 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bfe5bc39-a826-4cb4-ba4b-1b67dc59a312 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:13.632232 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bfe5bc39-a826-4cb4-ba4b-1b67dc59a312 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:13.632678 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bfe5bc39-a826-4cb4-ba4b-1b67dc59a312 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:13.669938 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-bfe5bc39-a826-4cb4-ba4b-1b67dc59a312 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056314 Aug 09 11:23:13.670578 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 390/741] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 9 11:23:13 2022] GET /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:23:13.738146 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-efb78382-ea9c-45b3-9407-ac50481e52f4 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:13.738831 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-efb78382-ea9c-45b3-9407-ac50481e52f4 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:13.748754 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-efb78382-ea9c-45b3-9407-ac50481e52f4 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:13.749787 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-efb78382-ea9c-45b3-9407-ac50481e52f4 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:13.750541 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-efb78382-ea9c-45b3-9407-ac50481e52f4 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:13.751436 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-efb78382-ea9c-45b3-9407-ac50481e52f4 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:13.751915 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-efb78382-ea9c-45b3-9407-ac50481e52f4 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:13.752346 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-efb78382-ea9c-45b3-9407-ac50481e52f4 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:13.907109 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-efb78382-ea9c-45b3-9407-ac50481e52f4 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:13.919454 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-efb78382-ea9c-45b3-9407-ac50481e52f4 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078" status: 200 len: 1734 microversion: 2.1 time: 0.185287 Aug 09 11:23:13.927843 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 352/742] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:13 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 => generated 1734 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:14.682975 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-1883298f-3908-4fce-a10b-46bac482dadf tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:14.685405 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-1883298f-3908-4fce-a10b-46bac482dadf tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: c883c714-443c-4df9-aaa0-8e7e81764fc2] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:14.691915 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1883298f-3908-4fce-a10b-46bac482dadf tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:14.692423 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1883298f-3908-4fce-a10b-46bac482dadf tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:14.692853 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1883298f-3908-4fce-a10b-46bac482dadf tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:14.693598 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1883298f-3908-4fce-a10b-46bac482dadf tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:14.694041 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1883298f-3908-4fce-a10b-46bac482dadf tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:14.694922 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1883298f-3908-4fce-a10b-46bac482dadf tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:14.725890 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-1883298f-3908-4fce-a10b-46bac482dadf tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046775 Aug 09 11:23:14.731888 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 391/743] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 9 11:23:14 2022] GET /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 11:23:14.794193 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-3022aaa6-990b-4d4c-8d0f-b55137c7a8d7 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:14.795471 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-3022aaa6-990b-4d4c-8d0f-b55137c7a8d7 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: c883c714-443c-4df9-aaa0-8e7e81764fc2] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:14.802672 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3022aaa6-990b-4d4c-8d0f-b55137c7a8d7 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:14.803145 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3022aaa6-990b-4d4c-8d0f-b55137c7a8d7 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:14.803845 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3022aaa6-990b-4d4c-8d0f-b55137c7a8d7 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:14.804833 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3022aaa6-990b-4d4c-8d0f-b55137c7a8d7 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:14.805555 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3022aaa6-990b-4d4c-8d0f-b55137c7a8d7 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:14.805981 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3022aaa6-990b-4d4c-8d0f-b55137c7a8d7 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:14.833673 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-3022aaa6-990b-4d4c-8d0f-b55137c7a8d7 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: c883c714-443c-4df9-aaa0-8e7e81764fc2] Going to try to terminate instance {{(pid=117684) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 11:23:14.920455 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-3022aaa6-990b-4d4c-8d0f-b55137c7a8d7 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2" status: 204 len: 0 microversion: 2.1 time: 0.129860 Aug 09 11:23:14.921251 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 353/744] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 9 11:23:14 2022] DELETE /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 11:23:14.930591 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-9524d7a4-5b39-4a7d-8956-426b2ce5f7c5 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:14.931207 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-9524d7a4-5b39-4a7d-8956-426b2ce5f7c5 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: c883c714-443c-4df9-aaa0-8e7e81764fc2] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:14.938992 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9524d7a4-5b39-4a7d-8956-426b2ce5f7c5 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:14.939668 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9524d7a4-5b39-4a7d-8956-426b2ce5f7c5 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:14.940095 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9524d7a4-5b39-4a7d-8956-426b2ce5f7c5 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:14.940897 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9524d7a4-5b39-4a7d-8956-426b2ce5f7c5 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:14.941127 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-b5d36fb0-3d4b-43f5-924c-a5b7c0c63c76 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:14.941323 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9524d7a4-5b39-4a7d-8956-426b2ce5f7c5 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:14.941746 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9524d7a4-5b39-4a7d-8956-426b2ce5f7c5 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:14.941977 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-b5d36fb0-3d4b-43f5-924c-a5b7c0c63c76 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:14.948721 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b5d36fb0-3d4b-43f5-924c-a5b7c0c63c76 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:14.949215 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b5d36fb0-3d4b-43f5-924c-a5b7c0c63c76 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:14.949667 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b5d36fb0-3d4b-43f5-924c-a5b7c0c63c76 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:14.950376 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b5d36fb0-3d4b-43f5-924c-a5b7c0c63c76 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:14.950817 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b5d36fb0-3d4b-43f5-924c-a5b7c0c63c76 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:14.951248 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b5d36fb0-3d4b-43f5-924c-a5b7c0c63c76 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:15.163716 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-9524d7a4-5b39-4a7d-8956-426b2ce5f7c5 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:15.166280 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-b5d36fb0-3d4b-43f5-924c-a5b7c0c63c76 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:15.171666 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-9524d7a4-5b39-4a7d-8956-426b2ce5f7c5 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2" status: 200 len: 1682 microversion: 2.1 time: 0.245739 Aug 09 11:23:15.172256 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 392/745] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:14 2022] GET /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2 => generated 1682 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:15.175434 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-b5d36fb0-3d4b-43f5-924c-a5b7c0c63c76 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078" status: 200 len: 1734 microversion: 2.1 time: 0.238790 Aug 09 11:23:15.176154 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 354/746] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:14 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 => generated 1734 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:16.193637 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-ef591379-48ef-4e83-ab68-ca7526362f5b tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:16.194562 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-ef591379-48ef-4e83-ab68-ca7526362f5b tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: c883c714-443c-4df9-aaa0-8e7e81764fc2] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:16.195841 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-bd41af66-c857-445f-861a-6b723afdb943 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:16.196481 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-bd41af66-c857-445f-861a-6b723afdb943 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:16.199567 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell0:SELECT=12 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:23:16.201435 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ef591379-48ef-4e83-ab68-ca7526362f5b tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:16.201903 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ef591379-48ef-4e83-ab68-ca7526362f5b tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:16.202454 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ef591379-48ef-4e83-ab68-ca7526362f5b tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:16.203170 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ef591379-48ef-4e83-ab68-ca7526362f5b tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:16.203531 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-bd41af66-c857-445f-861a-6b723afdb943 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:16.203644 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ef591379-48ef-4e83-ab68-ca7526362f5b tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:16.204009 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-bd41af66-c857-445f-861a-6b723afdb943 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:16.204128 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ef591379-48ef-4e83-ab68-ca7526362f5b tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:16.204536 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-bd41af66-c857-445f-861a-6b723afdb943 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:16.205229 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-bd41af66-c857-445f-861a-6b723afdb943 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:16.205677 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-bd41af66-c857-445f-861a-6b723afdb943 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:16.206094 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-bd41af66-c857-445f-861a-6b723afdb943 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:16.417493 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-ef591379-48ef-4e83-ab68-ca7526362f5b tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:16.420074 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-bd41af66-c857-445f-861a-6b723afdb943 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:16.425389 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-ef591379-48ef-4e83-ab68-ca7526362f5b tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2" status: 200 len: 1682 microversion: 2.1 time: 0.235717 Aug 09 11:23:16.425937 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 393/747] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:16 2022] GET /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2 => generated 1682 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:16.428240 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-bd41af66-c857-445f-861a-6b723afdb943 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078" status: 200 len: 1734 microversion: 2.1 time: 0.236092 Aug 09 11:23:16.429038 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 355/748] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:16 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 => generated 1734 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:17.447912 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-28053cc1-9c27-456c-990a-b92e7190ceb4 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:17.448528 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-28053cc1-9c27-456c-990a-b92e7190ceb4 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: c883c714-443c-4df9-aaa0-8e7e81764fc2] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:17.451067 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-3bcd85bc-f09c-4e7d-bc63-6bdfd8e70ef5 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:17.451941 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-3bcd85bc-f09c-4e7d-bc63-6bdfd8e70ef5 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:17.455281 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-28053cc1-9c27-456c-990a-b92e7190ceb4 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:17.455714 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-28053cc1-9c27-456c-990a-b92e7190ceb4 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:17.456141 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-28053cc1-9c27-456c-990a-b92e7190ceb4 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:17.456848 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-28053cc1-9c27-456c-990a-b92e7190ceb4 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:17.457307 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-28053cc1-9c27-456c-990a-b92e7190ceb4 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:17.457716 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-28053cc1-9c27-456c-990a-b92e7190ceb4 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:17.458819 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3bcd85bc-f09c-4e7d-bc63-6bdfd8e70ef5 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:17.459368 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3bcd85bc-f09c-4e7d-bc63-6bdfd8e70ef5 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:17.460019 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3bcd85bc-f09c-4e7d-bc63-6bdfd8e70ef5 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:17.461055 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3bcd85bc-f09c-4e7d-bc63-6bdfd8e70ef5 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:17.461569 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3bcd85bc-f09c-4e7d-bc63-6bdfd8e70ef5 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:17.462789 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3bcd85bc-f09c-4e7d-bc63-6bdfd8e70ef5 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:17.789259 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-28053cc1-9c27-456c-990a-b92e7190ceb4 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:17.797404 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-28053cc1-9c27-456c-990a-b92e7190ceb4 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2" status: 200 len: 1614 microversion: 2.1 time: 0.354089 Aug 09 11:23:17.797998 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 394/749] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:17 2022] GET /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2 => generated 1614 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:23:17.952535 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-3bcd85bc-f09c-4e7d-bc63-6bdfd8e70ef5 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:17.962030 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-3bcd85bc-f09c-4e7d-bc63-6bdfd8e70ef5 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078" status: 200 len: 1734 microversion: 2.1 time: 0.514726 Aug 09 11:23:17.962779 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 356/750] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:17 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 => generated 1734 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:18.035636 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-9811f457-5260-4878-82d6-e985706acbd0 req-b463cf76-4ddc-4538-80e5-28ade0779df0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c883c714-443c-4df9-aaa0-8e7e81764fc2", "name": "network-vif-deleted", "tag": "266ca4c8-2fb3-4c5b-b9a9-6457541c0746"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:23:18.046758 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-9811f457-5260-4878-82d6-e985706acbd0 req-b463cf76-4ddc-4538-80e5-28ade0779df0 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:18.047636 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-9811f457-5260-4878-82d6-e985706acbd0 req-b463cf76-4ddc-4538-80e5-28ade0779df0 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:18.048156 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-9811f457-5260-4878-82d6-e985706acbd0 req-b463cf76-4ddc-4538-80e5-28ade0779df0 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:18.061559 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-9811f457-5260-4878-82d6-e985706acbd0 req-b463cf76-4ddc-4538-80e5-28ade0779df0 service nova] Creating event network-vif-deleted:266ca4c8-2fb3-4c5b-b9a9-6457541c0746 for instance c883c714-443c-4df9-aaa0-8e7e81764fc2 on hv-cinder-85251 Aug 09 11:23:18.067032 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-9811f457-5260-4878-82d6-e985706acbd0 req-b463cf76-4ddc-4538-80e5-28ade0779df0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035098 Aug 09 11:23:18.067677 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 395/751] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:23:18.821594 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-93f5be7a-358a-4c6c-b710-34adf5adc231 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:18.822230 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-93f5be7a-358a-4c6c-b710-34adf5adc231 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: c883c714-443c-4df9-aaa0-8e7e81764fc2] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:18.829211 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-93f5be7a-358a-4c6c-b710-34adf5adc231 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:18.829689 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-93f5be7a-358a-4c6c-b710-34adf5adc231 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:18.830116 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-93f5be7a-358a-4c6c-b710-34adf5adc231 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:18.830811 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-93f5be7a-358a-4c6c-b710-34adf5adc231 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:18.831248 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-93f5be7a-358a-4c6c-b710-34adf5adc231 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:18.831665 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-93f5be7a-358a-4c6c-b710-34adf5adc231 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:18.845954 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.wsgi [None req-93f5be7a-358a-4c6c-b710-34adf5adc231 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] HTTP exception thrown: Instance c883c714-443c-4df9-aaa0-8e7e81764fc2 could not be found. Aug 09 11:23:18.847980 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-93f5be7a-358a-4c6c-b710-34adf5adc231 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Request method failure captured: Aug 09 11:23:18.847980 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: request: GET /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2 HTTP/1.1 Aug 09 11:23:18.847980 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept: application/json Aug 09 11:23:18.847980 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept-Encoding: identity Aug 09 11:23:18.847980 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Connection: close Aug 09 11:23:18.847980 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Length: 0 Aug 09 11:23:18.847980 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Type: application/json Aug 09 11:23:18.847980 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Host: 10.222.0.27 Aug 09 11:23:18.847980 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Openstack-System-Scope: None Aug 09 11:23:18.847980 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: User-Agent: python-urllib3/1.26.11 Aug 09 11:23:18.847980 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Auth-Token: gAAAAABi8kJrkCuZ0ZtlZIUmAC-EK2I0okp8exzRXbUBoHrpFGaG17TfS3kn4sSvkBzyMOMoCBQBmvOs9UrhF5xw2U46aP5Pxlq5Kj8piUuPsDzn7s8ETM_3P18gyColYBDIhcjSMUGohuoeVN3S8QIKYIofZURyiH1QY4Vi6NWdxWuymPkih0k Aug 09 11:23:18.847980 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Id: None Aug 09 11:23:18.847980 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Name: None Aug 09 11:23:18.847980 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Identity-Status: Confirmed Aug 09 11:23:18.847980 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Is-Admin-Project: True Aug 09 11:23:18.847980 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Id: default Aug 09 11:23:18.847980 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Name: Default Aug 09 11:23:18.847980 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Id: cba1dd0b689b4fff847b6fd3787b143c Aug 09 11:23:18.847980 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Name: tempest-AttachVolumeNegativeTest-1410930012 Aug 09 11:23:18.847980 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Role: member,reader Aug 09 11:23:18.847980 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Roles: member,reader Aug 09 11:23:18.849556 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:23:18.849556 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant: tempest-AttachVolumeNegativeTest-1410930012 Aug 09 11:23:18.849556 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Id: cba1dd0b689b4fff847b6fd3787b143c Aug 09 11:23:18.849556 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1410930012 Aug 09 11:23:18.849556 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User: tempest-AttachVolumeNegativeTest-1410930012-project Aug 09 11:23:18.849556 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Id: default Aug 09 11:23:18.849556 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Name: Default Aug 09 11:23:18.849556 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Id: f4da6dd860bb45d1a703a18c2512ffe4 Aug 09 11:23:18.849556 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Name: tempest-AttachVolumeNegativeTest-1410930012-project Aug 09 11:23:18.849556 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: method: > Aug 09 11:23:18.849556 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: exception: Instance c883c714-443c-4df9-aaa0-8e7e81764fc2 could not be found. Aug 09 11:23:18.849556 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: action_args: {'id': 'c883c714-443c-4df9-aaa0-8e7e81764fc2'} Aug 09 11:23:18.850437 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:23:18.850437 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:23:18.850437 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:23:18.850437 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:23:18.850437 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:23:18.850437 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:23:18.850437 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:23:18.850437 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:23:18.850437 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:23:18.850437 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:23:18.850437 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c883c714-443c-4df9-aaa0-8e7e81764fc2 could not be found. Aug 09 11:23:18.850437 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:23:18.850437 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:23:18.850437 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:23:18.850437 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:23:18.850437 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:23:18.850437 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:23:18.850437 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:23:18.850437 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:23:18.850437 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:23:18.852119 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:23:18.852119 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:23:18.852119 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:23:18.852119 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:23:18.852119 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:23:18.852119 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:23:18.852119 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:23:18.852119 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c883c714-443c-4df9-aaa0-8e7e81764fc2 could not be found. Aug 09 11:23:18.852119 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:23:18.852119 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:23:18.852119 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:23:18.852119 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:23:18.852119 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:23:18.852119 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:23:18.852119 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:23:18.852119 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:23:18.852119 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c883c714-443c-4df9-aaa0-8e7e81764fc2 could not be found. Aug 09 11:23:18.852119 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:23:18.853487 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-93f5be7a-358a-4c6c-b710-34adf5adc231 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Returning 404 to user: Instance c883c714-443c-4df9-aaa0-8e7e81764fc2 could not be found. {{(pid=117684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:23:18.853487 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-93f5be7a-358a-4c6c-b710-34adf5adc231 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2" status: 404 len: 111 microversion: 2.1 time: 0.033202 Aug 09 11:23:18.854171 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 357/752] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:18 2022] GET /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:23:18.859862 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-8ec8cebf-ead0-4573-b356-6a3b46e95f92 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '.version_select at 0x7f2821fb0550>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:18.881628 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-8ec8cebf-ead0-4573-b356-6a3b46e95f92 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-583137067" status: 202 len: 0 microversion: 2.1 time: 0.026448 Aug 09 11:23:18.882261 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 396/753] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Aug 9 11:23:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-583137067 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:23:18.983020 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-b4a2c506-1781-468d-8e7f-460ec2e34b4b tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:18.983948 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-b4a2c506-1781-468d-8e7f-460ec2e34b4b tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:18.990274 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b4a2c506-1781-468d-8e7f-460ec2e34b4b tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:18.991095 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b4a2c506-1781-468d-8e7f-460ec2e34b4b tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:18.991762 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b4a2c506-1781-468d-8e7f-460ec2e34b4b tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:18.992521 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b4a2c506-1781-468d-8e7f-460ec2e34b4b tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:18.993127 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b4a2c506-1781-468d-8e7f-460ec2e34b4b tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:18.993713 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b4a2c506-1781-468d-8e7f-460ec2e34b4b tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:19.158353 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-b4a2c506-1781-468d-8e7f-460ec2e34b4b tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:19.167378 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-b4a2c506-1781-468d-8e7f-460ec2e34b4b tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078" status: 200 len: 1734 microversion: 2.1 time: 0.188154 Aug 09 11:23:19.167970 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 358/754] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:18 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 => generated 1734 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:19.515862 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-2a098861-2c43-4863-8f4e-625e0cda43ef tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:23:19.516720 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-2a098861-2c43-4863-8f4e-625e0cda43ef tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:19.524820 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2a098861-2c43-4863-8f4e-625e0cda43ef tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:19.525387 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2a098861-2c43-4863-8f4e-625e0cda43ef tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:19.525914 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2a098861-2c43-4863-8f4e-625e0cda43ef tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:19.526715 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2a098861-2c43-4863-8f4e-625e0cda43ef tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:19.527259 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2a098861-2c43-4863-8f4e-625e0cda43ef tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:19.527741 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2a098861-2c43-4863-8f4e-625e0cda43ef tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:19.551275 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.objects.instance [None req-2a098861-2c43-4863-8f4e-625e0cda43ef tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lazy-loading 'flavor' on Instance uuid b683e1f9-1d37-46d4-a7a1-9f15b514336e {{(pid=117685) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:23:19.579705 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-b151e719-4aa8-410d-a7ff-1c0a58f1f8d0 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Action: 'create', calling method: .version_select at 0x7f2821e25280>, body: {"keypair": {"name": "tempest-keypair-2004963148", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWt7dgQAmEvc3nCgJfj47fS49mRbo5XEwkmBl5MqFqkefINQo3CoXLYcXJR6RVSwSwZVdkgFOfVb0si3unMeGtc39hnTve7W/ZV08KMjEtSFrQsHC2eEuAQydf5+No4yw=="}} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:23:19.595396 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.quota [None req-b151e719-4aa8-410d-a7ff-1c0a58f1f8d0 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Getting quotas for project cba1dd0b689b4fff847b6fd3787b143c. Resources: {'key_pairs'} {{(pid=117684) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:23:19.597693 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:23:19.599863 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.quota [None req-b151e719-4aa8-410d-a7ff-1c0a58f1f8d0 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Getting quotas for user f4da6dd860bb45d1a703a18c2512ffe4 and project cba1dd0b689b4fff847b6fd3787b143c. Resources: {'key_pairs'} {{(pid=117684) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:23:19.628482 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-b151e719-4aa8-410d-a7ff-1c0a58f1f8d0 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052646 Aug 09 11:23:19.629087 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 359/755] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 9 11:23:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:23:19.670801 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-2a098861-2c43-4863-8f4e-625e0cda43ef tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "POST /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e/action" status: 202 len: 0 microversion: 2.1 time: 0.158836 Aug 09 11:23:19.671412 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 397/756] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 9 11:23:19 2022] POST /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:23:19.680151 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-47937964-af3d-4ed0-bd4b-0479557e60ac tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:19.680868 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-47937964-af3d-4ed0-bd4b-0479557e60ac tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:19.687909 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-47937964-af3d-4ed0-bd4b-0479557e60ac tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:19.689279 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-47937964-af3d-4ed0-bd4b-0479557e60ac tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:19.689842 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-47937964-af3d-4ed0-bd4b-0479557e60ac tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:19.690597 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-47937964-af3d-4ed0-bd4b-0479557e60ac tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:19.691111 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-47937964-af3d-4ed0-bd4b-0479557e60ac tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:19.691594 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-47937964-af3d-4ed0-bd4b-0479557e60ac tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:19.880255 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-47937964-af3d-4ed0-bd4b-0479557e60ac tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:19.888918 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-47937964-af3d-4ed0-bd4b-0479557e60ac tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1570 microversion: 2.1 time: 0.212861 Aug 09 11:23:19.889484 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 360/757] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:19 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1570 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:20.191869 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-97719223-007a-4a68-a5ea-693d081bf9ca tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:20.192587 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-97719223-007a-4a68-a5ea-693d081bf9ca tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:20.199594 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-97719223-007a-4a68-a5ea-693d081bf9ca tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:20.200115 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-97719223-007a-4a68-a5ea-693d081bf9ca tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:20.200590 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-97719223-007a-4a68-a5ea-693d081bf9ca tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:20.201281 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-97719223-007a-4a68-a5ea-693d081bf9ca tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:20.201718 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-97719223-007a-4a68-a5ea-693d081bf9ca tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:20.202132 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-97719223-007a-4a68-a5ea-693d081bf9ca tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:20.332766 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-97719223-007a-4a68-a5ea-693d081bf9ca tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:20.341216 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-97719223-007a-4a68-a5ea-693d081bf9ca tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078" status: 200 len: 1734 microversion: 2.1 time: 0.154126 Aug 09 11:23:20.341795 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 398/758] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:20 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:20.917379 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-cbdb6059-b088-44b1-9e6a-36726e050c8d tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:20.917782 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-cbdb6059-b088-44b1-9e6a-36726e050c8d tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:20.926492 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cbdb6059-b088-44b1-9e6a-36726e050c8d tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:20.926992 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cbdb6059-b088-44b1-9e6a-36726e050c8d tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:20.927416 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cbdb6059-b088-44b1-9e6a-36726e050c8d tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:20.928111 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cbdb6059-b088-44b1-9e6a-36726e050c8d tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:20.928664 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cbdb6059-b088-44b1-9e6a-36726e050c8d tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:20.929202 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cbdb6059-b088-44b1-9e6a-36726e050c8d tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:20.982934 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-ed58dfd4-6aff-4512-92ee-a5034cb7a22e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1024038903", "imageRef": "2321e9a0-fe0f-47fd-9c4b-8868eb5a00af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9bf85ef7-1c92-4e5f-a5b9-fcad7da95bf2"}], "security_groups": [{"name": "tempest-securitygroup--493795055"}], "key_name": "tempest-keypair-2004963148", "user_data": "}} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:23:21.083816 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-cbdb6059-b088-44b1-9e6a-36726e050c8d tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:21.092171 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-cbdb6059-b088-44b1-9e6a-36726e050c8d tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1570 microversion: 2.1 time: 0.185043 Aug 09 11:23:21.092911 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 361/759] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:20 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1570 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:21.109316 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.network.neutron [None req-ed58dfd4-6aff-4512-92ee-a5034cb7a22e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] validate_networks() for [('9bf85ef7-1c92-4e5f-a5b9-fcad7da95bf2', None, None, None, None, None)] {{(pid=117685) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 11:23:21.364344 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-8a6d9041-3d87-43ea-88c1-6b75404695c1 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:21.365166 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-8a6d9041-3d87-43ea-88c1-6b75404695c1 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:21.371946 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8a6d9041-3d87-43ea-88c1-6b75404695c1 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:21.372467 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8a6d9041-3d87-43ea-88c1-6b75404695c1 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:21.372900 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8a6d9041-3d87-43ea-88c1-6b75404695c1 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:21.373588 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8a6d9041-3d87-43ea-88c1-6b75404695c1 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:21.374030 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8a6d9041-3d87-43ea-88c1-6b75404695c1 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:21.374443 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8a6d9041-3d87-43ea-88c1-6b75404695c1 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:21.579830 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-8a6d9041-3d87-43ea-88c1-6b75404695c1 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:21.589181 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-8a6d9041-3d87-43ea-88c1-6b75404695c1 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078" status: 200 len: 1734 microversion: 2.1 time: 0.229238 Aug 09 11:23:21.589754 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 362/760] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:21 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 => generated 1734 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:21.609196 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-ed58dfd4-6aff-4512-92ee-a5034cb7a22e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Flavor limits 0:0:0 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 11:23:21.609708 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-ed58dfd4-6aff-4512-92ee-a5034cb7a22e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Image limits 0:0:0 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 11:23:21.610080 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-ed58dfd4-6aff-4512-92ee-a5034cb7a22e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Flavor pref 0:0:0 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 11:23:21.610478 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-ed58dfd4-6aff-4512-92ee-a5034cb7a22e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Image pref 0:0:0 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 11:23:21.610908 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-ed58dfd4-6aff-4512-92ee-a5034cb7a22e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 11:23:21.621457 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ed58dfd4-6aff-4512-92ee-a5034cb7a22e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:21.621936 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ed58dfd4-6aff-4512-92ee-a5034cb7a22e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:21.622399 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ed58dfd4-6aff-4512-92ee-a5034cb7a22e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:21.623073 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ed58dfd4-6aff-4512-92ee-a5034cb7a22e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:21.623514 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ed58dfd4-6aff-4512-92ee-a5034cb7a22e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:21.623931 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-ed58dfd4-6aff-4512-92ee-a5034cb7a22e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:21.641489 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.quota [None req-ed58dfd4-6aff-4512-92ee-a5034cb7a22e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Getting quotas for project cba1dd0b689b4fff847b6fd3787b143c. Resources: {'cores', 'instances', 'ram'} {{(pid=117685) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:23:21.645827 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.quota [None req-ed58dfd4-6aff-4512-92ee-a5034cb7a22e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Getting quotas for user f4da6dd860bb45d1a703a18c2512ffe4 and project cba1dd0b689b4fff847b6fd3787b143c. Resources: {'cores', 'instances', 'ram'} {{(pid=117685) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:23:21.657030 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-ed58dfd4-6aff-4512-92ee-a5034cb7a22e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Going to run 1 instances... {{(pid=117685) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 11:23:21.659338 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-ed58dfd4-6aff-4512-92ee-a5034cb7a22e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 92aed47a-39ca-4174-9ae4-b99c2fb029e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2321e9a0-fe0f-47fd-9c4b-8868eb5a00af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117685) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 11:23:21.713627 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-ed58dfd4-6aff-4512-92ee-a5034cb7a22e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.734922 Aug 09 11:23:21.714287 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 399/761] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 9 11:23:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 11:23:21.727830 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-cfe32330-c3e8-4948-97ec-78989fd4f772 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:21.727830 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-cfe32330-c3e8-4948-97ec-78989fd4f772 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 92aed47a-39ca-4174-9ae4-b99c2fb029e1] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:21.785862 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-cfe32330-c3e8-4948-97ec-78989fd4f772 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:21.793191 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-cfe32330-c3e8-4948-97ec-78989fd4f772 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/92aed47a-39ca-4174-9ae4-b99c2fb029e1" status: 200 len: 1242 microversion: 2.1 time: 0.071509 Aug 09 11:23:21.793828 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 363/762] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:21 2022] GET /compute/v2.1/servers/92aed47a-39ca-4174-9ae4-b99c2fb029e1 => generated 1242 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:22.114155 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-e6bfd150-ffa9-4482-9fda-98fab581e8e4 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:22.114756 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-e6bfd150-ffa9-4482-9fda-98fab581e8e4 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:22.121019 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e6bfd150-ffa9-4482-9fda-98fab581e8e4 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:22.121502 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e6bfd150-ffa9-4482-9fda-98fab581e8e4 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:22.121937 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e6bfd150-ffa9-4482-9fda-98fab581e8e4 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:22.122609 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e6bfd150-ffa9-4482-9fda-98fab581e8e4 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:22.123045 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e6bfd150-ffa9-4482-9fda-98fab581e8e4 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:22.123459 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e6bfd150-ffa9-4482-9fda-98fab581e8e4 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:22.262991 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-e6bfd150-ffa9-4482-9fda-98fab581e8e4 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:22.273100 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-e6bfd150-ffa9-4482-9fda-98fab581e8e4 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1570 microversion: 2.1 time: 0.162949 Aug 09 11:23:22.273922 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 400/763] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:22 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:22.401017 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-152a9136-4c4a-4733-82c0-ca8afade1b24 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1919348531", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1024053701", "security_groups": [{"name": "tempest-secgroup-smoke-1801499321"}], "block_device_mapping_v2": [{"uuid": "a253af8c-01cb-4bad-8319-721eab47729f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "940543e4-99c0-4b6e-ad06-93fe4eaedd74"}]}} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:23:22.518106 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.network.neutron [None req-152a9136-4c4a-4733-82c0-ca8afade1b24 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] validate_networks() for [('940543e4-99c0-4b6e-ad06-93fe4eaedd74', None, None, None, None, None)] {{(pid=117684) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 11:23:22.610796 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-fbbc324e-efbf-40bb-ba01-815eaa99e1a7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:22.611401 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-fbbc324e-efbf-40bb-ba01-815eaa99e1a7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:22.618522 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fbbc324e-efbf-40bb-ba01-815eaa99e1a7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:22.619044 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fbbc324e-efbf-40bb-ba01-815eaa99e1a7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:22.619470 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fbbc324e-efbf-40bb-ba01-815eaa99e1a7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:22.620170 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fbbc324e-efbf-40bb-ba01-815eaa99e1a7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:22.620699 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fbbc324e-efbf-40bb-ba01-815eaa99e1a7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:22.621099 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-fbbc324e-efbf-40bb-ba01-815eaa99e1a7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:22.790726 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-fbbc324e-efbf-40bb-ba01-815eaa99e1a7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:22.799141 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-fbbc324e-efbf-40bb-ba01-815eaa99e1a7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078" status: 200 len: 1734 microversion: 2.1 time: 0.192501 Aug 09 11:23:22.800007 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 401/764] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:22 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 => generated 1734 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:23:22.814756 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-a51c71e9-a220-4280-965f-8dd6b299d360 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:22.815504 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-a51c71e9-a220-4280-965f-8dd6b299d360 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 92aed47a-39ca-4174-9ae4-b99c2fb029e1] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:22.827848 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a51c71e9-a220-4280-965f-8dd6b299d360 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:22.828380 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a51c71e9-a220-4280-965f-8dd6b299d360 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:22.828825 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a51c71e9-a220-4280-965f-8dd6b299d360 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:22.829524 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a51c71e9-a220-4280-965f-8dd6b299d360 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:22.829968 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a51c71e9-a220-4280-965f-8dd6b299d360 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:22.830386 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a51c71e9-a220-4280-965f-8dd6b299d360 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:22.920605 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-a51c71e9-a220-4280-965f-8dd6b299d360 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:22.929824 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:23:22.932680 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-a51c71e9-a220-4280-965f-8dd6b299d360 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/92aed47a-39ca-4174-9ae4-b99c2fb029e1" status: 200 len: 1294 microversion: 2.1 time: 0.121763 Aug 09 11:23:22.933459 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 402/765] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:22 2022] GET /compute/v2.1/servers/92aed47a-39ca-4174-9ae4-b99c2fb029e1 => generated 1294 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:23:23.130132 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-152a9136-4c4a-4733-82c0-ca8afade1b24 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Flavor limits 0:0:0 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 11:23:23.130561 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-152a9136-4c4a-4733-82c0-ca8afade1b24 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Image limits 0:0:0 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 11:23:23.131378 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-152a9136-4c4a-4733-82c0-ca8afade1b24 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Flavor pref 0:0:0 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 11:23:23.131378 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-152a9136-4c4a-4733-82c0-ca8afade1b24 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Image pref 0:0:0 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 11:23:23.131889 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.virt.hardware [None req-152a9136-4c4a-4733-82c0-ca8afade1b24 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 11:23:23.141387 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-152a9136-4c4a-4733-82c0-ca8afade1b24 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:23.141860 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-152a9136-4c4a-4733-82c0-ca8afade1b24 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:23.142270 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-152a9136-4c4a-4733-82c0-ca8afade1b24 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:23.143220 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-152a9136-4c4a-4733-82c0-ca8afade1b24 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:23.143662 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-152a9136-4c4a-4733-82c0-ca8afade1b24 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:23.144074 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-152a9136-4c4a-4733-82c0-ca8afade1b24 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:23.161738 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.quota [None req-152a9136-4c4a-4733-82c0-ca8afade1b24 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Getting quotas for project bfd671fcff7e4b24b5415a3a1b70ad0f. Resources: {'cores', 'instances', 'ram'} {{(pid=117684) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:23:23.167003 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.quota [None req-152a9136-4c4a-4733-82c0-ca8afade1b24 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Getting quotas for user 5b4c4030b5fb4381a598a54588880b75 and project bfd671fcff7e4b24b5415a3a1b70ad0f. Resources: {'cores', 'instances', 'ram'} {{(pid=117684) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:23:23.226351 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-152a9136-4c4a-4733-82c0-ca8afade1b24 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Going to run 1 instances... {{(pid=117684) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 11:23:23.228497 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-152a9136-4c4a-4733-82c0-ca8afade1b24 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 935b9a57-1104-4ad6-a0ba-3301edf35661] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a253af8c-01cb-4bad-8319-721eab47729f',volume_size=None,volume_type=None)] {{(pid=117684) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 11:23:23.294915 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-d3d32a0f-dfe9-44b3-8b96-cf2b2e468600 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:23.295444 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-d3d32a0f-dfe9-44b3-8b96-cf2b2e468600 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:23.299277 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:23:23.305995 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d3d32a0f-dfe9-44b3-8b96-cf2b2e468600 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:23.306777 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d3d32a0f-dfe9-44b3-8b96-cf2b2e468600 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:23.307423 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d3d32a0f-dfe9-44b3-8b96-cf2b2e468600 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:23.308420 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d3d32a0f-dfe9-44b3-8b96-cf2b2e468600 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:23.309022 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d3d32a0f-dfe9-44b3-8b96-cf2b2e468600 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:23.309616 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d3d32a0f-dfe9-44b3-8b96-cf2b2e468600 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:23.375185 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-152a9136-4c4a-4733-82c0-ca8afade1b24 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.978200 Aug 09 11:23:23.375837 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 364/766] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 9 11:23:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 980 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 11:23:23.386912 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-961df48a-b0ed-434a-b244-00313a2a39a1 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:23.387522 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-961df48a-b0ed-434a-b244-00313a2a39a1 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 935b9a57-1104-4ad6-a0ba-3301edf35661] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:23.499964 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-961df48a-b0ed-434a-b244-00313a2a39a1 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:23.507907 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-961df48a-b0ed-434a-b244-00313a2a39a1 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661" status: 200 len: 1095 microversion: 2.1 time: 0.124743 Aug 09 11:23:23.508508 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 365/767] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:23 2022] GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661 => generated 1095 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:23:23.590547 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-d3d32a0f-dfe9-44b3-8b96-cf2b2e468600 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:23.599094 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-d3d32a0f-dfe9-44b3-8b96-cf2b2e468600 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1570 microversion: 2.1 time: 0.308178 Aug 09 11:23:23.619529 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 403/768] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:23 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1570 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:23.822030 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-753c85ea-c346-4196-b239-8808725e0f11 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:23.822966 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-753c85ea-c346-4196-b239-8808725e0f11 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:23.829562 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-753c85ea-c346-4196-b239-8808725e0f11 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:23.830168 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-753c85ea-c346-4196-b239-8808725e0f11 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:23.830829 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-753c85ea-c346-4196-b239-8808725e0f11 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:23.831755 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-753c85ea-c346-4196-b239-8808725e0f11 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:23.832628 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-753c85ea-c346-4196-b239-8808725e0f11 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:23.833255 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-753c85ea-c346-4196-b239-8808725e0f11 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:23.954102 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-7a913061-da67-49de-bfdc-985448882a66 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:23.954978 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-7a913061-da67-49de-bfdc-985448882a66 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 92aed47a-39ca-4174-9ae4-b99c2fb029e1] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:23.961608 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7a913061-da67-49de-bfdc-985448882a66 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:23.962351 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7a913061-da67-49de-bfdc-985448882a66 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:23.962951 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7a913061-da67-49de-bfdc-985448882a66 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:23.963815 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7a913061-da67-49de-bfdc-985448882a66 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:23.964477 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7a913061-da67-49de-bfdc-985448882a66 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:23.965052 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7a913061-da67-49de-bfdc-985448882a66 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:24.051817 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-753c85ea-c346-4196-b239-8808725e0f11 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:24.067680 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-753c85ea-c346-4196-b239-8808725e0f11 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078" status: 200 len: 1734 microversion: 2.1 time: 0.250051 Aug 09 11:23:24.068434 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 366/769] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:23 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 => generated 1734 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:24.225187 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-7a913061-da67-49de-bfdc-985448882a66 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:24.232888 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-7a913061-da67-49de-bfdc-985448882a66 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/92aed47a-39ca-4174-9ae4-b99c2fb029e1" status: 200 len: 1367 microversion: 2.1 time: 0.282753 Aug 09 11:23:24.233461 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 404/770] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:23 2022] GET /compute/v2.1/servers/92aed47a-39ca-4174-9ae4-b99c2fb029e1 => generated 1367 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:24.529490 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-baf9c20c-768e-4718-8170-e26651816a2a tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:24.530226 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-baf9c20c-768e-4718-8170-e26651816a2a tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 935b9a57-1104-4ad6-a0ba-3301edf35661] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:24.545676 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-baf9c20c-768e-4718-8170-e26651816a2a tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:24.547630 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-baf9c20c-768e-4718-8170-e26651816a2a tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:24.548234 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-baf9c20c-768e-4718-8170-e26651816a2a tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:24.549928 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-baf9c20c-768e-4718-8170-e26651816a2a tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:24.550842 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-baf9c20c-768e-4718-8170-e26651816a2a tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:24.551745 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-baf9c20c-768e-4718-8170-e26651816a2a tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:24.621972 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-76856624-1471-4a73-a829-a890f42fa1f3 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:24.622349 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-76856624-1471-4a73-a829-a890f42fa1f3 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:24.628909 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-76856624-1471-4a73-a829-a890f42fa1f3 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:24.629396 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-76856624-1471-4a73-a829-a890f42fa1f3 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:24.629831 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-76856624-1471-4a73-a829-a890f42fa1f3 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:24.630531 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-76856624-1471-4a73-a829-a890f42fa1f3 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:24.630980 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-76856624-1471-4a73-a829-a890f42fa1f3 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:24.631474 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-76856624-1471-4a73-a829-a890f42fa1f3 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:24.656401 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-baf9c20c-768e-4718-8170-e26651816a2a tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:24.664679 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-baf9c20c-768e-4718-8170-e26651816a2a tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661" status: 200 len: 1201 microversion: 2.1 time: 0.139061 Aug 09 11:23:24.668318 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 367/771] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:24 2022] GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661 => generated 1201 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:24.880980 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [req-e8ac8104-fa5d-48bb-90ff-1eb2b6a7f779 req-669b2be7-98bd-4046-abf3-adcbe4f9a43b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92aed47a-39ca-4174-9ae4-b99c2fb029e1", "tag": "6e636562-656a-4e4d-8241-b867d69fdc72"}]} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:23:24.890666 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-e8ac8104-fa5d-48bb-90ff-1eb2b6a7f779 req-669b2be7-98bd-4046-abf3-adcbe4f9a43b service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:24.891391 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-e8ac8104-fa5d-48bb-90ff-1eb2b6a7f779 req-669b2be7-98bd-4046-abf3-adcbe4f9a43b service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:24.891915 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-e8ac8104-fa5d-48bb-90ff-1eb2b6a7f779 req-669b2be7-98bd-4046-abf3-adcbe4f9a43b service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:24.906211 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.compute.server_external_events [req-e8ac8104-fa5d-48bb-90ff-1eb2b6a7f779 req-669b2be7-98bd-4046-abf3-adcbe4f9a43b service nova] Creating event network-changed:6e636562-656a-4e4d-8241-b867d69fdc72 for instance 92aed47a-39ca-4174-9ae4-b99c2fb029e1 on hv-cinder-85251 Aug 09 11:23:24.911944 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [req-e8ac8104-fa5d-48bb-90ff-1eb2b6a7f779 req-669b2be7-98bd-4046-abf3-adcbe4f9a43b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103528 Aug 09 11:23:24.914228 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 368/772] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:23:24.936190 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-76856624-1471-4a73-a829-a890f42fa1f3 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:24.945817 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-76856624-1471-4a73-a829-a890f42fa1f3 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1570 microversion: 2.1 time: 0.328293 Aug 09 11:23:24.946507 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 405/773] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:24 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1570 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:23:25.093009 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-eeb73803-70c8-4e7a-9451-a6ba1f972b9b tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:25.094042 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-eeb73803-70c8-4e7a-9451-a6ba1f972b9b tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:25.101295 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-eeb73803-70c8-4e7a-9451-a6ba1f972b9b tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:25.102001 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-eeb73803-70c8-4e7a-9451-a6ba1f972b9b tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:25.102970 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-eeb73803-70c8-4e7a-9451-a6ba1f972b9b tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:25.103708 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-eeb73803-70c8-4e7a-9451-a6ba1f972b9b tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:25.104357 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-eeb73803-70c8-4e7a-9451-a6ba1f972b9b tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:25.104879 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-eeb73803-70c8-4e7a-9451-a6ba1f972b9b tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:25.121922 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:23:25.254747 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-d10e4335-6bd6-46d3-8f3a-c60856d32be5 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:25.255609 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-d10e4335-6bd6-46d3-8f3a-c60856d32be5 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 92aed47a-39ca-4174-9ae4-b99c2fb029e1] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:25.266365 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d10e4335-6bd6-46d3-8f3a-c60856d32be5 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:25.268854 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d10e4335-6bd6-46d3-8f3a-c60856d32be5 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:25.269712 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d10e4335-6bd6-46d3-8f3a-c60856d32be5 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:25.270546 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d10e4335-6bd6-46d3-8f3a-c60856d32be5 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:25.276214 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d10e4335-6bd6-46d3-8f3a-c60856d32be5 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:25.276885 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d10e4335-6bd6-46d3-8f3a-c60856d32be5 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:25.323626 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-eeb73803-70c8-4e7a-9451-a6ba1f972b9b tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:25.332674 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-eeb73803-70c8-4e7a-9451-a6ba1f972b9b tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078" status: 200 len: 1734 microversion: 2.1 time: 0.245356 Aug 09 11:23:25.345208 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 369/774] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:25 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 => generated 1734 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:25.515745 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-d10e4335-6bd6-46d3-8f3a-c60856d32be5 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:25.524115 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-d10e4335-6bd6-46d3-8f3a-c60856d32be5 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/92aed47a-39ca-4174-9ae4-b99c2fb029e1" status: 200 len: 1367 microversion: 2.1 time: 0.273474 Aug 09 11:23:25.524952 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 406/775] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:25 2022] GET /compute/v2.1/servers/92aed47a-39ca-4174-9ae4-b99c2fb029e1 => generated 1367 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:25.690500 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-0c450ab1-3f25-446f-b6aa-3b0c854f3773 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:25.691084 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-0c450ab1-3f25-446f-b6aa-3b0c854f3773 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 935b9a57-1104-4ad6-a0ba-3301edf35661] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:25.698751 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0c450ab1-3f25-446f-b6aa-3b0c854f3773 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:25.699241 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0c450ab1-3f25-446f-b6aa-3b0c854f3773 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:25.699670 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0c450ab1-3f25-446f-b6aa-3b0c854f3773 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:25.700437 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0c450ab1-3f25-446f-b6aa-3b0c854f3773 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:25.700883 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0c450ab1-3f25-446f-b6aa-3b0c854f3773 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:25.701300 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0c450ab1-3f25-446f-b6aa-3b0c854f3773 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:25.847064 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-0c450ab1-3f25-446f-b6aa-3b0c854f3773 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:25.855858 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-0c450ab1-3f25-446f-b6aa-3b0c854f3773 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661" status: 200 len: 1267 microversion: 2.1 time: 0.169217 Aug 09 11:23:25.868292 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 370/776] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:25 2022] GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:25.967321 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-89cc6d31-04cc-4d2c-9879-191fcc94c1a5 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:25.967963 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-89cc6d31-04cc-4d2c-9879-191fcc94c1a5 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:25.974730 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-89cc6d31-04cc-4d2c-9879-191fcc94c1a5 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:25.975210 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-89cc6d31-04cc-4d2c-9879-191fcc94c1a5 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:25.975775 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-89cc6d31-04cc-4d2c-9879-191fcc94c1a5 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:25.976512 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-89cc6d31-04cc-4d2c-9879-191fcc94c1a5 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:25.976963 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-89cc6d31-04cc-4d2c-9879-191fcc94c1a5 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:25.977379 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-89cc6d31-04cc-4d2c-9879-191fcc94c1a5 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:26.118091 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-89cc6d31-04cc-4d2c-9879-191fcc94c1a5 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:26.125947 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-89cc6d31-04cc-4d2c-9879-191fcc94c1a5 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1570 microversion: 2.1 time: 0.162467 Aug 09 11:23:26.126515 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 407/777] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:25 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:26.282010 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [req-f5e8d165-e0e7-4f54-a9f9-0d4c96edc40d req-4e70c75c-ceb0-472f-8f2c-85daf0d5a9c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "935b9a57-1104-4ad6-a0ba-3301edf35661", "tag": "d9a273cd-bfdb-4a55-a1e8-c1fbe783a476"}]} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:23:26.291567 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-f5e8d165-e0e7-4f54-a9f9-0d4c96edc40d req-4e70c75c-ceb0-472f-8f2c-85daf0d5a9c1 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:26.292027 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-f5e8d165-e0e7-4f54-a9f9-0d4c96edc40d req-4e70c75c-ceb0-472f-8f2c-85daf0d5a9c1 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:26.292493 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-f5e8d165-e0e7-4f54-a9f9-0d4c96edc40d req-4e70c75c-ceb0-472f-8f2c-85daf0d5a9c1 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:26.302990 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.compute.server_external_events [req-f5e8d165-e0e7-4f54-a9f9-0d4c96edc40d req-4e70c75c-ceb0-472f-8f2c-85daf0d5a9c1 service nova] Creating event network-changed:d9a273cd-bfdb-4a55-a1e8-c1fbe783a476 for instance 935b9a57-1104-4ad6-a0ba-3301edf35661 on hv-cinder-85251 Aug 09 11:23:26.308078 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [req-f5e8d165-e0e7-4f54-a9f9-0d4c96edc40d req-4e70c75c-ceb0-472f-8f2c-85daf0d5a9c1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089649 Aug 09 11:23:26.308721 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 371/778] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:23:26.358051 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-277013e1-ff3b-4096-afac-51142b33c4e4 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:26.359083 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-277013e1-ff3b-4096-afac-51142b33c4e4 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:26.367987 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-277013e1-ff3b-4096-afac-51142b33c4e4 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:26.368493 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-277013e1-ff3b-4096-afac-51142b33c4e4 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:26.368921 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-277013e1-ff3b-4096-afac-51142b33c4e4 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:26.369604 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-277013e1-ff3b-4096-afac-51142b33c4e4 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:26.370043 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-277013e1-ff3b-4096-afac-51142b33c4e4 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:26.370456 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-277013e1-ff3b-4096-afac-51142b33c4e4 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:26.521165 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-277013e1-ff3b-4096-afac-51142b33c4e4 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:26.529940 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-277013e1-ff3b-4096-afac-51142b33c4e4 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078" status: 200 len: 1734 microversion: 2.1 time: 0.178371 Aug 09 11:23:26.530545 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 408/779] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:26 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 => generated 1734 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:26.546317 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-40c12a4b-997f-4eab-abdc-53445f4ac5d1 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:26.547034 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-40c12a4b-997f-4eab-abdc-53445f4ac5d1 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 92aed47a-39ca-4174-9ae4-b99c2fb029e1] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:26.553480 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-40c12a4b-997f-4eab-abdc-53445f4ac5d1 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:26.554076 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-40c12a4b-997f-4eab-abdc-53445f4ac5d1 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:26.554528 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-40c12a4b-997f-4eab-abdc-53445f4ac5d1 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:26.555218 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-40c12a4b-997f-4eab-abdc-53445f4ac5d1 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:26.555665 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-40c12a4b-997f-4eab-abdc-53445f4ac5d1 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:26.556085 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-40c12a4b-997f-4eab-abdc-53445f4ac5d1 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:26.776956 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-40c12a4b-997f-4eab-abdc-53445f4ac5d1 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:26.784760 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-40c12a4b-997f-4eab-abdc-53445f4ac5d1 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/92aed47a-39ca-4174-9ae4-b99c2fb029e1" status: 200 len: 1367 microversion: 2.1 time: 0.242938 Aug 09 11:23:26.785357 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 372/780] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:26 2022] GET /compute/v2.1/servers/92aed47a-39ca-4174-9ae4-b99c2fb029e1 => generated 1367 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:26.877781 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-51a3b977-e3f8-47ce-ba76-a6dc90be9d84 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:26.878309 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-51a3b977-e3f8-47ce-ba76-a6dc90be9d84 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 935b9a57-1104-4ad6-a0ba-3301edf35661] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:26.884596 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-51a3b977-e3f8-47ce-ba76-a6dc90be9d84 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:26.885072 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-51a3b977-e3f8-47ce-ba76-a6dc90be9d84 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:26.885496 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-51a3b977-e3f8-47ce-ba76-a6dc90be9d84 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:26.886167 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-51a3b977-e3f8-47ce-ba76-a6dc90be9d84 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:26.886607 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-51a3b977-e3f8-47ce-ba76-a6dc90be9d84 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:26.887020 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-51a3b977-e3f8-47ce-ba76-a6dc90be9d84 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:27.028610 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-51a3b977-e3f8-47ce-ba76-a6dc90be9d84 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:27.040134 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-51a3b977-e3f8-47ce-ba76-a6dc90be9d84 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661" status: 200 len: 1267 microversion: 2.1 time: 0.166067 Aug 09 11:23:27.040884 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 409/781] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:26 2022] GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:27.150565 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-f1a70af1-8e75-47cf-820e-58319e2ba4a7 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:27.151158 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-f1a70af1-8e75-47cf-820e-58319e2ba4a7 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:27.159640 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f1a70af1-8e75-47cf-820e-58319e2ba4a7 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:27.160325 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f1a70af1-8e75-47cf-820e-58319e2ba4a7 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:27.160871 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f1a70af1-8e75-47cf-820e-58319e2ba4a7 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:27.161896 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f1a70af1-8e75-47cf-820e-58319e2ba4a7 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:27.162548 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f1a70af1-8e75-47cf-820e-58319e2ba4a7 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:27.163526 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f1a70af1-8e75-47cf-820e-58319e2ba4a7 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:27.314768 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-f1a70af1-8e75-47cf-820e-58319e2ba4a7 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:27.322753 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-f1a70af1-8e75-47cf-820e-58319e2ba4a7 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1570 microversion: 2.1 time: 0.177863 Aug 09 11:23:27.323305 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 373/782] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:27 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1570 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:27.556374 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-336a1736-1f38-4bb1-a3ca-bec507c07b65 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:27.557396 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-336a1736-1f38-4bb1-a3ca-bec507c07b65 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:27.568026 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-336a1736-1f38-4bb1-a3ca-bec507c07b65 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:27.569490 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-336a1736-1f38-4bb1-a3ca-bec507c07b65 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:27.570467 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-336a1736-1f38-4bb1-a3ca-bec507c07b65 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:27.571163 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-336a1736-1f38-4bb1-a3ca-bec507c07b65 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:27.571610 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-336a1736-1f38-4bb1-a3ca-bec507c07b65 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:27.572038 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-336a1736-1f38-4bb1-a3ca-bec507c07b65 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:27.706535 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-336a1736-1f38-4bb1-a3ca-bec507c07b65 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:27.715438 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-336a1736-1f38-4bb1-a3ca-bec507c07b65 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078" status: 200 len: 1734 microversion: 2.1 time: 0.166273 Aug 09 11:23:27.716020 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 410/783] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:27 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:27.819714 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-1fc7d7f8-7064-4ab7-b5b3-de18c9dba9c9 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:27.821246 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-1fc7d7f8-7064-4ab7-b5b3-de18c9dba9c9 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 92aed47a-39ca-4174-9ae4-b99c2fb029e1] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:27.830223 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1fc7d7f8-7064-4ab7-b5b3-de18c9dba9c9 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:27.837113 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1fc7d7f8-7064-4ab7-b5b3-de18c9dba9c9 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:27.837769 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1fc7d7f8-7064-4ab7-b5b3-de18c9dba9c9 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:27.842082 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1fc7d7f8-7064-4ab7-b5b3-de18c9dba9c9 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:27.842606 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1fc7d7f8-7064-4ab7-b5b3-de18c9dba9c9 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:27.843155 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1fc7d7f8-7064-4ab7-b5b3-de18c9dba9c9 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:28.040178 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-1fc7d7f8-7064-4ab7-b5b3-de18c9dba9c9 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:28.049130 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-1fc7d7f8-7064-4ab7-b5b3-de18c9dba9c9 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/92aed47a-39ca-4174-9ae4-b99c2fb029e1" status: 200 len: 1367 microversion: 2.1 time: 0.234097 Aug 09 11:23:28.049707 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 374/784] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:27 2022] GET /compute/v2.1/servers/92aed47a-39ca-4174-9ae4-b99c2fb029e1 => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:28.067609 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-77dbee0e-5003-48f3-8bbb-bed8edb6e14b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:28.068911 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-77dbee0e-5003-48f3-8bbb-bed8edb6e14b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 935b9a57-1104-4ad6-a0ba-3301edf35661] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:28.075437 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-77dbee0e-5003-48f3-8bbb-bed8edb6e14b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:28.075832 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-77dbee0e-5003-48f3-8bbb-bed8edb6e14b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:28.076258 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-77dbee0e-5003-48f3-8bbb-bed8edb6e14b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:28.076977 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-77dbee0e-5003-48f3-8bbb-bed8edb6e14b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:28.077383 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-77dbee0e-5003-48f3-8bbb-bed8edb6e14b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:28.077961 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-77dbee0e-5003-48f3-8bbb-bed8edb6e14b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:28.343499 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-b3d2d75d-88a1-4328-add4-95a9d808bf09 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:28.344071 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-b3d2d75d-88a1-4328-add4-95a9d808bf09 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:28.350620 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b3d2d75d-88a1-4328-add4-95a9d808bf09 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:28.351743 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b3d2d75d-88a1-4328-add4-95a9d808bf09 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:28.352182 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b3d2d75d-88a1-4328-add4-95a9d808bf09 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:28.352934 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b3d2d75d-88a1-4328-add4-95a9d808bf09 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:28.353388 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b3d2d75d-88a1-4328-add4-95a9d808bf09 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:28.353812 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b3d2d75d-88a1-4328-add4-95a9d808bf09 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:28.603123 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-77dbee0e-5003-48f3-8bbb-bed8edb6e14b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:28.613424 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-77dbee0e-5003-48f3-8bbb-bed8edb6e14b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661" status: 200 len: 1267 microversion: 2.1 time: 0.549746 Aug 09 11:23:28.614010 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 411/785] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:28 2022] GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661 => generated 1267 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:28.657257 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-b3d2d75d-88a1-4328-add4-95a9d808bf09 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:28.666702 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-b3d2d75d-88a1-4328-add4-95a9d808bf09 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1570 microversion: 2.1 time: 0.327272 Aug 09 11:23:28.667356 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 375/786] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:28 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1570 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:28.736134 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-3b9a8513-e41d-4ce0-ae7a-64dd3404404e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:28.736792 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-3b9a8513-e41d-4ce0-ae7a-64dd3404404e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:28.743022 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3b9a8513-e41d-4ce0-ae7a-64dd3404404e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:28.743499 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3b9a8513-e41d-4ce0-ae7a-64dd3404404e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:28.743924 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3b9a8513-e41d-4ce0-ae7a-64dd3404404e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:28.744615 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3b9a8513-e41d-4ce0-ae7a-64dd3404404e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:28.745074 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3b9a8513-e41d-4ce0-ae7a-64dd3404404e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:28.745485 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3b9a8513-e41d-4ce0-ae7a-64dd3404404e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:28.889474 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-3b9a8513-e41d-4ce0-ae7a-64dd3404404e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:28.898167 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-3b9a8513-e41d-4ce0-ae7a-64dd3404404e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078" status: 200 len: 1734 microversion: 2.1 time: 0.165957 Aug 09 11:23:28.898716 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 412/787] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:28 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:29.070277 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-b81be480-2ecf-431c-8fc1-11f1447490ec tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:29.071014 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-b81be480-2ecf-431c-8fc1-11f1447490ec tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 92aed47a-39ca-4174-9ae4-b99c2fb029e1] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:29.077608 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b81be480-2ecf-431c-8fc1-11f1447490ec tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:29.078084 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b81be480-2ecf-431c-8fc1-11f1447490ec tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:29.078512 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b81be480-2ecf-431c-8fc1-11f1447490ec tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:29.079198 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b81be480-2ecf-431c-8fc1-11f1447490ec tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:29.079642 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b81be480-2ecf-431c-8fc1-11f1447490ec tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:29.080055 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b81be480-2ecf-431c-8fc1-11f1447490ec tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:29.214589 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-b81be480-2ecf-431c-8fc1-11f1447490ec tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:29.232569 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-b81be480-2ecf-431c-8fc1-11f1447490ec tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/92aed47a-39ca-4174-9ae4-b99c2fb029e1" status: 200 len: 1367 microversion: 2.1 time: 0.166464 Aug 09 11:23:29.233226 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 376/788] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:29 2022] GET /compute/v2.1/servers/92aed47a-39ca-4174-9ae4-b99c2fb029e1 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:29.637007 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-92a1f8ec-f58e-41e5-82d6-074aa066ab21 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:29.637784 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-92a1f8ec-f58e-41e5-82d6-074aa066ab21 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 935b9a57-1104-4ad6-a0ba-3301edf35661] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:29.647080 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-92a1f8ec-f58e-41e5-82d6-074aa066ab21 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:29.647800 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-92a1f8ec-f58e-41e5-82d6-074aa066ab21 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:29.648242 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-92a1f8ec-f58e-41e5-82d6-074aa066ab21 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:29.648961 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-92a1f8ec-f58e-41e5-82d6-074aa066ab21 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:29.649410 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-92a1f8ec-f58e-41e5-82d6-074aa066ab21 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:29.649831 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-92a1f8ec-f58e-41e5-82d6-074aa066ab21 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:29.690609 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-db7f8f1f-1893-4175-acb2-c1f677324340 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:29.691289 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-db7f8f1f-1893-4175-acb2-c1f677324340 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:29.699659 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-db7f8f1f-1893-4175-acb2-c1f677324340 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:29.700167 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-db7f8f1f-1893-4175-acb2-c1f677324340 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:29.700638 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-db7f8f1f-1893-4175-acb2-c1f677324340 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:29.701337 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-db7f8f1f-1893-4175-acb2-c1f677324340 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:29.701778 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-db7f8f1f-1893-4175-acb2-c1f677324340 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:29.702201 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-db7f8f1f-1893-4175-acb2-c1f677324340 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:29.847885 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-92a1f8ec-f58e-41e5-82d6-074aa066ab21 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:29.855708 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-92a1f8ec-f58e-41e5-82d6-074aa066ab21 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661" status: 200 len: 1267 microversion: 2.1 time: 0.224311 Aug 09 11:23:29.856298 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 413/789] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:29 2022] GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661 => generated 1267 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:29.883835 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-db7f8f1f-1893-4175-acb2-c1f677324340 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:29.891679 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-db7f8f1f-1893-4175-acb2-c1f677324340 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1570 microversion: 2.1 time: 0.205470 Aug 09 11:23:29.892249 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 377/790] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:29 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1570 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:29.919422 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-78b6acfe-e215-4bc6-8d6f-9dda1bf95d1f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:29.920041 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-78b6acfe-e215-4bc6-8d6f-9dda1bf95d1f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:29.928201 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-78b6acfe-e215-4bc6-8d6f-9dda1bf95d1f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:29.928733 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-78b6acfe-e215-4bc6-8d6f-9dda1bf95d1f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:29.929163 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-78b6acfe-e215-4bc6-8d6f-9dda1bf95d1f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:29.930021 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-78b6acfe-e215-4bc6-8d6f-9dda1bf95d1f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:29.930555 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-78b6acfe-e215-4bc6-8d6f-9dda1bf95d1f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:29.930969 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-78b6acfe-e215-4bc6-8d6f-9dda1bf95d1f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:29.935912 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-3e10a9df-e771-47db-9170-d8b6618dbe89 req-2d35fb31-584d-42c3-b5ed-32b752577e54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92aed47a-39ca-4174-9ae4-b99c2fb029e1", "name": "network-vif-plugged", "status": "completed", "tag": "6e636562-656a-4e4d-8241-b867d69fdc72"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:23:29.945373 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-3e10a9df-e771-47db-9170-d8b6618dbe89 req-2d35fb31-584d-42c3-b5ed-32b752577e54 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:29.945851 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-3e10a9df-e771-47db-9170-d8b6618dbe89 req-2d35fb31-584d-42c3-b5ed-32b752577e54 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:29.946293 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-3e10a9df-e771-47db-9170-d8b6618dbe89 req-2d35fb31-584d-42c3-b5ed-32b752577e54 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:29.957539 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-3e10a9df-e771-47db-9170-d8b6618dbe89 req-2d35fb31-584d-42c3-b5ed-32b752577e54 service nova] Creating event network-vif-plugged:6e636562-656a-4e4d-8241-b867d69fdc72 for instance 92aed47a-39ca-4174-9ae4-b99c2fb029e1 on hv-cinder-85251 Aug 09 11:23:29.962587 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-3e10a9df-e771-47db-9170-d8b6618dbe89 req-2d35fb31-584d-42c3-b5ed-32b752577e54 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092646 Aug 09 11:23:29.963182 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 414/791] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:23:30.065913 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-78b6acfe-e215-4bc6-8d6f-9dda1bf95d1f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:30.074122 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-78b6acfe-e215-4bc6-8d6f-9dda1bf95d1f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078" status: 200 len: 1714 microversion: 2.1 time: 0.158619 Aug 09 11:23:30.074713 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 378/792] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:29 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 => generated 1714 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:30.187264 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-702f0207-d817-4060-a327-016b461e23d7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:30.187849 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-702f0207-d817-4060-a327-016b461e23d7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:30.196472 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-702f0207-d817-4060-a327-016b461e23d7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:30.196933 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-702f0207-d817-4060-a327-016b461e23d7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:30.197360 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-702f0207-d817-4060-a327-016b461e23d7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:30.198098 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-702f0207-d817-4060-a327-016b461e23d7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:30.198825 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-702f0207-d817-4060-a327-016b461e23d7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:30.199334 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-702f0207-d817-4060-a327-016b461e23d7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:30.254219 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-c894adc4-06e3-438c-921c-dcb62c3c8d5e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:30.255149 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-c894adc4-06e3-438c-921c-dcb62c3c8d5e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 92aed47a-39ca-4174-9ae4-b99c2fb029e1] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:30.262586 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c894adc4-06e3-438c-921c-dcb62c3c8d5e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:30.263100 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c894adc4-06e3-438c-921c-dcb62c3c8d5e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:30.263707 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c894adc4-06e3-438c-921c-dcb62c3c8d5e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:30.264464 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c894adc4-06e3-438c-921c-dcb62c3c8d5e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:30.264913 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c894adc4-06e3-438c-921c-dcb62c3c8d5e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:30.265341 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c894adc4-06e3-438c-921c-dcb62c3c8d5e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:30.295930 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.wsgi [None req-702f0207-d817-4060-a327-016b461e23d7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] HTTP exception thrown: Cannot 'detach_volume' instance 8009a1a2-4c8e-4953-ba5c-faab2db05078 while it is in vm_state rescued Aug 09 11:23:30.297888 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-702f0207-d817-4060-a327-016b461e23d7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Request method failure captured: Aug 09 11:23:30.297888 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: request: DELETE /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078/os-volume_attachments/6118fb56-c184-44e6-b8e5-97a95cbac9d2 HTTP/1.1 Aug 09 11:23:30.297888 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Accept: application/json Aug 09 11:23:30.297888 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Accept-Encoding: identity Aug 09 11:23:30.297888 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Connection: close Aug 09 11:23:30.297888 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Content-Length: 0 Aug 09 11:23:30.297888 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Content-Type: application/json Aug 09 11:23:30.297888 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Host: 10.222.0.27 Aug 09 11:23:30.297888 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Openstack-System-Scope: None Aug 09 11:23:30.297888 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: User-Agent: python-urllib3/1.26.11 Aug 09 11:23:30.297888 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Auth-Token: gAAAAABi8kK4ZURPQKT-E-bhJo1FLIIqaFjoTaLi0t_9gs19mh3N7gqZ6GeAerCuuiTJe0dYAhdQ2iR_bfI_b0ZwFkvbIx4r8Jm4-7nh0tWhT2kBjRkOHrLdvaHoe9ZT_a_-HZxYdn72f859LpQhFNf_Fvg_jqnrIaRWCS_QgEMwXjTJVjY3_8I Aug 09 11:23:30.297888 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Domain-Id: None Aug 09 11:23:30.297888 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Domain-Name: None Aug 09 11:23:30.297888 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Identity-Status: Confirmed Aug 09 11:23:30.297888 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Is-Admin-Project: True Aug 09 11:23:30.297888 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Domain-Id: default Aug 09 11:23:30.297888 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Domain-Name: Default Aug 09 11:23:30.297888 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Id: 45bb3a603ddc4d3b8042b6ae687c896e Aug 09 11:23:30.297888 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-338750798 Aug 09 11:23:30.297888 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Role: member,reader Aug 09 11:23:30.297888 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Roles: member,reader Aug 09 11:23:30.299445 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/45bb3a603ddc4d3b8042b6ae687c896e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_45bb3a603ddc4d3b8042b6ae687c896e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/45bb3a603ddc4d3b8042b6ae687c896e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/45bb3a603ddc4d3b8042b6ae687c896e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:23:30.299445 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant: tempest-ServerRescueNegativeTestJSON-338750798 Aug 09 11:23:30.299445 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant-Id: 45bb3a603ddc4d3b8042b6ae687c896e Aug 09 11:23:30.299445 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-338750798 Aug 09 11:23:30.299445 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User: tempest-ServerRescueNegativeTestJSON-338750798-project Aug 09 11:23:30.299445 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Domain-Id: default Aug 09 11:23:30.299445 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Domain-Name: Default Aug 09 11:23:30.299445 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Id: 3a1cd35a257f4b0f99141580c14bad48 Aug 09 11:23:30.299445 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Name: tempest-ServerRescueNegativeTestJSON-338750798-project Aug 09 11:23:30.299445 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: method: > Aug 09 11:23:30.299445 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: exception: Cannot 'detach_volume' instance 8009a1a2-4c8e-4953-ba5c-faab2db05078 while it is in vm_state rescued Aug 09 11:23:30.300250 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: action_args: {'server_id': '8009a1a2-4c8e-4953-ba5c-faab2db05078', 'id': '6118fb56-c184-44e6-b8e5-97a95cbac9d2'} Aug 09 11:23:30.300250 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:23:30.300250 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:23:30.300250 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 09 11:23:30.300250 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 09 11:23:30.300250 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 11:23:30.300250 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 11:23:30.300250 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 09 11:23:30.300250 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 09 11:23:30.300250 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8009a1a2-4c8e-4953-ba5c-faab2db05078 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 09 11:23:30.300250 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:23:30.300250 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:23:30.300250 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:23:30.300250 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:23:30.300250 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:23:30.300250 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:23:30.300250 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:23:30.300250 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:23:30.300250 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:23:30.300250 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:23:30.301731 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 09 11:23:30.301731 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 09 11:23:30.301731 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 09 11:23:30.301731 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 11:23:30.301731 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 8009a1a2-4c8e-4953-ba5c-faab2db05078 while it is in vm_state rescued Aug 09 11:23:30.301731 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:23:30.301731 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:23:30.301731 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:23:30.301731 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:23:30.301731 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:23:30.301731 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:23:30.301731 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:23:30.301731 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:23:30.301731 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 8009a1a2-4c8e-4953-ba5c-faab2db05078 while it is in vm_state rescued Aug 09 11:23:30.301731 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:23:30.301731 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-702f0207-d817-4060-a327-016b461e23d7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Returning 409 to user: Cannot 'detach_volume' instance 8009a1a2-4c8e-4953-ba5c-faab2db05078 while it is in vm_state rescued {{(pid=117685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:23:30.302904 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-702f0207-d817-4060-a327-016b461e23d7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078/os-volume_attachments/6118fb56-c184-44e6-b8e5-97a95cbac9d2" status: 409 len: 152 microversion: 2.1 time: 0.118331 Aug 09 11:23:30.306937 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 415/793] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Aug 9 11:23:30 2022] DELETE /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078/os-volume_attachments/6118fb56-c184-44e6-b8e5-97a95cbac9d2 => generated 152 bytes in 125 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 11:23:30.312226 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-12e2f2c0-ada5-46b8-b517-0cc16abddb56 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:23:30.312867 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-12e2f2c0-ada5-46b8-b517-0cc16abddb56 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:30.318982 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-12e2f2c0-ada5-46b8-b517-0cc16abddb56 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:30.319594 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-12e2f2c0-ada5-46b8-b517-0cc16abddb56 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:30.320098 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-12e2f2c0-ada5-46b8-b517-0cc16abddb56 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:30.320899 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-12e2f2c0-ada5-46b8-b517-0cc16abddb56 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:30.321415 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-12e2f2c0-ada5-46b8-b517-0cc16abddb56 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:30.321938 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-12e2f2c0-ada5-46b8-b517-0cc16abddb56 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:30.395141 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-12e2f2c0-ada5-46b8-b517-0cc16abddb56 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "POST /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078/action" status: 202 len: 0 microversion: 2.1 time: 0.086587 Aug 09 11:23:30.399681 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 416/794] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 9 11:23:30 2022] POST /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:23:30.404838 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-e2c4a89a-d832-4b20-b211-2378a6013bfc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:30.405531 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-e2c4a89a-d832-4b20-b211-2378a6013bfc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:30.411743 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e2c4a89a-d832-4b20-b211-2378a6013bfc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:30.412221 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e2c4a89a-d832-4b20-b211-2378a6013bfc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:30.412687 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e2c4a89a-d832-4b20-b211-2378a6013bfc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:30.413626 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e2c4a89a-d832-4b20-b211-2378a6013bfc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:30.414192 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e2c4a89a-d832-4b20-b211-2378a6013bfc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:30.414780 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e2c4a89a-d832-4b20-b211-2378a6013bfc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:30.521959 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-c894adc4-06e3-438c-921c-dcb62c3c8d5e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:30.529970 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-c894adc4-06e3-438c-921c-dcb62c3c8d5e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/92aed47a-39ca-4174-9ae4-b99c2fb029e1" status: 200 len: 1367 microversion: 2.1 time: 0.279892 Aug 09 11:23:30.530671 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 379/795] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:30 2022] GET /compute/v2.1/servers/92aed47a-39ca-4174-9ae4-b99c2fb029e1 => generated 1367 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:30.565833 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-e2c4a89a-d832-4b20-b211-2378a6013bfc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:30.574492 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-e2c4a89a-d832-4b20-b211-2378a6013bfc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078" status: 200 len: 1722 microversion: 2.1 time: 0.173623 Aug 09 11:23:30.575056 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 417/796] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:30 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:23:30.880757 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-8161f59c-2bee-41aa-86da-f4da2f0ba466 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:30.881373 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-8161f59c-2bee-41aa-86da-f4da2f0ba466 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 935b9a57-1104-4ad6-a0ba-3301edf35661] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:30.888157 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8161f59c-2bee-41aa-86da-f4da2f0ba466 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:30.888691 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8161f59c-2bee-41aa-86da-f4da2f0ba466 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:30.889125 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8161f59c-2bee-41aa-86da-f4da2f0ba466 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:30.889818 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8161f59c-2bee-41aa-86da-f4da2f0ba466 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:30.890271 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8161f59c-2bee-41aa-86da-f4da2f0ba466 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:30.890696 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8161f59c-2bee-41aa-86da-f4da2f0ba466 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:30.914976 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-83c3487d-2caf-4570-88de-29b24182c801 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:30.916024 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-83c3487d-2caf-4570-88de-29b24182c801 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:30.922639 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-83c3487d-2caf-4570-88de-29b24182c801 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:30.923177 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-83c3487d-2caf-4570-88de-29b24182c801 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:30.923607 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-83c3487d-2caf-4570-88de-29b24182c801 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:30.924384 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-83c3487d-2caf-4570-88de-29b24182c801 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:30.924865 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-83c3487d-2caf-4570-88de-29b24182c801 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:30.925287 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-83c3487d-2caf-4570-88de-29b24182c801 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:31.077521 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-8161f59c-2bee-41aa-86da-f4da2f0ba466 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:31.085753 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-8161f59c-2bee-41aa-86da-f4da2f0ba466 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661" status: 200 len: 1267 microversion: 2.1 time: 0.209047 Aug 09 11:23:31.086430 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 380/797] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:30 2022] GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661 => generated 1267 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:31.109060 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-83c3487d-2caf-4570-88de-29b24182c801 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:31.119503 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-83c3487d-2caf-4570-88de-29b24182c801 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1570 microversion: 2.1 time: 0.208314 Aug 09 11:23:31.120067 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 418/798] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:30 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1570 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:31.555647 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-d897e337-bc15-422f-8764-c6a3b362b90d tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:31.556573 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-d897e337-bc15-422f-8764-c6a3b362b90d tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 92aed47a-39ca-4174-9ae4-b99c2fb029e1] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:31.567224 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d897e337-bc15-422f-8764-c6a3b362b90d tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:31.568030 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d897e337-bc15-422f-8764-c6a3b362b90d tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:31.568800 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d897e337-bc15-422f-8764-c6a3b362b90d tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:31.569888 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d897e337-bc15-422f-8764-c6a3b362b90d tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:31.570340 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d897e337-bc15-422f-8764-c6a3b362b90d tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:31.570767 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d897e337-bc15-422f-8764-c6a3b362b90d tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:31.595113 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-f114d88b-feb0-4a3a-9d04-896bc8eb2225 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:31.595727 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-f114d88b-feb0-4a3a-9d04-896bc8eb2225 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:31.601960 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f114d88b-feb0-4a3a-9d04-896bc8eb2225 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:31.602439 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f114d88b-feb0-4a3a-9d04-896bc8eb2225 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:31.602935 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f114d88b-feb0-4a3a-9d04-896bc8eb2225 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:31.603547 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f114d88b-feb0-4a3a-9d04-896bc8eb2225 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:31.603995 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f114d88b-feb0-4a3a-9d04-896bc8eb2225 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:31.604443 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f114d88b-feb0-4a3a-9d04-896bc8eb2225 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:31.608821 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:23:31.630161 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell0:SELECT=2 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:23:31.652724 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell0:SELECT=6 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:23:31.750428 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-d897e337-bc15-422f-8764-c6a3b362b90d tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:31.758675 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-d897e337-bc15-422f-8764-c6a3b362b90d tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/92aed47a-39ca-4174-9ae4-b99c2fb029e1" status: 200 len: 1367 microversion: 2.1 time: 0.210014 Aug 09 11:23:31.759284 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 381/799] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:31 2022] GET /compute/v2.1/servers/92aed47a-39ca-4174-9ae4-b99c2fb029e1 => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:31.779582 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-f114d88b-feb0-4a3a-9d04-896bc8eb2225 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:31.787766 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-f114d88b-feb0-4a3a-9d04-896bc8eb2225 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078" status: 200 len: 1722 microversion: 2.1 time: 0.196542 Aug 09 11:23:31.788373 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 419/800] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:31 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:32.111171 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-436936be-0917-4f37-b666-eb47fd91dce5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:32.112172 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-436936be-0917-4f37-b666-eb47fd91dce5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 935b9a57-1104-4ad6-a0ba-3301edf35661] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:32.122555 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-436936be-0917-4f37-b666-eb47fd91dce5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:32.123340 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-436936be-0917-4f37-b666-eb47fd91dce5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:32.124052 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-436936be-0917-4f37-b666-eb47fd91dce5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:32.125240 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-436936be-0917-4f37-b666-eb47fd91dce5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:32.125984 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-436936be-0917-4f37-b666-eb47fd91dce5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:32.126673 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-436936be-0917-4f37-b666-eb47fd91dce5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:32.140799 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-a374ed91-2d19-4e38-928d-70f51748c714 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:32.141424 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-a374ed91-2d19-4e38-928d-70f51748c714 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:32.148547 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a374ed91-2d19-4e38-928d-70f51748c714 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:32.149026 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a374ed91-2d19-4e38-928d-70f51748c714 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:32.149577 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a374ed91-2d19-4e38-928d-70f51748c714 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:32.150269 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a374ed91-2d19-4e38-928d-70f51748c714 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:32.150708 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a374ed91-2d19-4e38-928d-70f51748c714 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:32.151122 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a374ed91-2d19-4e38-928d-70f51748c714 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:32.335468 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-436936be-0917-4f37-b666-eb47fd91dce5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:32.343363 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-436936be-0917-4f37-b666-eb47fd91dce5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661" status: 200 len: 1267 microversion: 2.1 time: 0.238693 Aug 09 11:23:32.343914 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 382/801] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:32 2022] GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661 => generated 1267 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:32.348451 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-a374ed91-2d19-4e38-928d-70f51748c714 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:32.356981 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-a374ed91-2d19-4e38-928d-70f51748c714 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1570 microversion: 2.1 time: 0.220271 Aug 09 11:23:32.357580 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 420/802] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:32 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1570 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:32.785448 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-ae51d2ec-a707-4e9a-bc0e-d6992bec42cf tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:32.786298 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-ae51d2ec-a707-4e9a-bc0e-d6992bec42cf tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 92aed47a-39ca-4174-9ae4-b99c2fb029e1] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:32.794020 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ae51d2ec-a707-4e9a-bc0e-d6992bec42cf tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:32.794498 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ae51d2ec-a707-4e9a-bc0e-d6992bec42cf tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:32.794937 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ae51d2ec-a707-4e9a-bc0e-d6992bec42cf tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:32.795631 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ae51d2ec-a707-4e9a-bc0e-d6992bec42cf tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:32.796081 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ae51d2ec-a707-4e9a-bc0e-d6992bec42cf tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:32.796533 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ae51d2ec-a707-4e9a-bc0e-d6992bec42cf tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:32.809061 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-2ea58161-1528-4da2-a839-55d212f1631f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:32.809663 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-2ea58161-1528-4da2-a839-55d212f1631f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:32.815935 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2ea58161-1528-4da2-a839-55d212f1631f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:32.816452 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2ea58161-1528-4da2-a839-55d212f1631f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:32.816890 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2ea58161-1528-4da2-a839-55d212f1631f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:32.817576 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2ea58161-1528-4da2-a839-55d212f1631f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:32.818023 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2ea58161-1528-4da2-a839-55d212f1631f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:32.818439 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2ea58161-1528-4da2-a839-55d212f1631f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:32.997885 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-ae51d2ec-a707-4e9a-bc0e-d6992bec42cf tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:33.005641 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-ae51d2ec-a707-4e9a-bc0e-d6992bec42cf tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/92aed47a-39ca-4174-9ae4-b99c2fb029e1" status: 200 len: 1558 microversion: 2.1 time: 0.226444 Aug 09 11:23:33.006225 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 383/803] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:32 2022] GET /compute/v2.1/servers/92aed47a-39ca-4174-9ae4-b99c2fb029e1 => generated 1558 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:33.009892 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-2ea58161-1528-4da2-a839-55d212f1631f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:33.017791 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-2ea58161-1528-4da2-a839-55d212f1631f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078" status: 200 len: 1722 microversion: 2.1 time: 0.212665 Aug 09 11:23:33.018348 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 421/804] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:32 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 => generated 1722 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:33.026869 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-23195c86-5a2d-4e7f-b450-a2e452b060ac tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:33.027351 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-23195c86-5a2d-4e7f-b450-a2e452b060ac tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 92aed47a-39ca-4174-9ae4-b99c2fb029e1] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:33.033770 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-23195c86-5a2d-4e7f-b450-a2e452b060ac tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:33.034239 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-23195c86-5a2d-4e7f-b450-a2e452b060ac tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:33.034662 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-23195c86-5a2d-4e7f-b450-a2e452b060ac tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:33.035337 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-23195c86-5a2d-4e7f-b450-a2e452b060ac tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:33.035773 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-23195c86-5a2d-4e7f-b450-a2e452b060ac tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:33.036189 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-23195c86-5a2d-4e7f-b450-a2e452b060ac tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:33.112593 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-23195c86-5a2d-4e7f-b450-a2e452b060ac tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/92aed47a-39ca-4174-9ae4-b99c2fb029e1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089765 Aug 09 11:23:33.113230 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 384/805] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Aug 9 11:23:33 2022] GET /compute/v2.1/servers/92aed47a-39ca-4174-9ae4-b99c2fb029e1/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:23:33.365237 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-3aa5dd2d-fdae-458e-9eee-e86e6132e270 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:33.365852 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-3aa5dd2d-fdae-458e-9eee-e86e6132e270 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 935b9a57-1104-4ad6-a0ba-3301edf35661] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:33.372351 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3aa5dd2d-fdae-458e-9eee-e86e6132e270 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:33.372822 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3aa5dd2d-fdae-458e-9eee-e86e6132e270 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:33.373245 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3aa5dd2d-fdae-458e-9eee-e86e6132e270 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:33.373927 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3aa5dd2d-fdae-458e-9eee-e86e6132e270 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:33.374365 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3aa5dd2d-fdae-458e-9eee-e86e6132e270 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:33.374780 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3aa5dd2d-fdae-458e-9eee-e86e6132e270 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:33.383581 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-e6c5ff14-4891-4bbd-8978-a1a21fdc6562 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:33.384723 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-e6c5ff14-4891-4bbd-8978-a1a21fdc6562 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:33.387103 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell0:SELECT=2 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:23:33.394433 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e6c5ff14-4891-4bbd-8978-a1a21fdc6562 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:33.395524 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e6c5ff14-4891-4bbd-8978-a1a21fdc6562 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:33.396497 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e6c5ff14-4891-4bbd-8978-a1a21fdc6562 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:33.397375 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e6c5ff14-4891-4bbd-8978-a1a21fdc6562 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:33.398026 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e6c5ff14-4891-4bbd-8978-a1a21fdc6562 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:33.398596 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e6c5ff14-4891-4bbd-8978-a1a21fdc6562 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:33.504563 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell0:SELECT=14 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:23:33.710109 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-e6c5ff14-4891-4bbd-8978-a1a21fdc6562 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:33.718606 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-e6c5ff14-4891-4bbd-8978-a1a21fdc6562 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1570 microversion: 2.1 time: 0.339959 Aug 09 11:23:33.719553 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 385/806] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:33 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1570 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:33.822048 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-3aa5dd2d-fdae-458e-9eee-e86e6132e270 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:33.829709 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-3aa5dd2d-fdae-458e-9eee-e86e6132e270 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661" status: 200 len: 1267 microversion: 2.1 time: 0.468550 Aug 09 11:23:33.830274 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 422/807] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:33 2022] GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661 => generated 1267 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:34.039307 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-9b913aad-cac8-40de-ab5e-c24979278c4c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:34.040048 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-9b913aad-cac8-40de-ab5e-c24979278c4c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:34.047497 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9b913aad-cac8-40de-ab5e-c24979278c4c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:34.047955 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9b913aad-cac8-40de-ab5e-c24979278c4c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:34.048452 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9b913aad-cac8-40de-ab5e-c24979278c4c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:34.049144 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9b913aad-cac8-40de-ab5e-c24979278c4c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:34.049577 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9b913aad-cac8-40de-ab5e-c24979278c4c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:34.049965 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9b913aad-cac8-40de-ab5e-c24979278c4c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:34.235593 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-9b913aad-cac8-40de-ab5e-c24979278c4c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:34.244744 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-9b913aad-cac8-40de-ab5e-c24979278c4c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078" status: 200 len: 1722 microversion: 2.1 time: 0.209418 Aug 09 11:23:34.245316 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 386/808] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:34 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:34.341530 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-16f62960-7122-4012-b330-f79c7e7526a0 req-7223ad94-c847-483d-9550-3e80d2a373d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92aed47a-39ca-4174-9ae4-b99c2fb029e1", "tag": "6e636562-656a-4e4d-8241-b867d69fdc72"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:23:34.351301 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-16f62960-7122-4012-b330-f79c7e7526a0 req-7223ad94-c847-483d-9550-3e80d2a373d8 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:34.351769 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-16f62960-7122-4012-b330-f79c7e7526a0 req-7223ad94-c847-483d-9550-3e80d2a373d8 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:34.352160 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-16f62960-7122-4012-b330-f79c7e7526a0 req-7223ad94-c847-483d-9550-3e80d2a373d8 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:34.363285 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-16f62960-7122-4012-b330-f79c7e7526a0 req-7223ad94-c847-483d-9550-3e80d2a373d8 service nova] Creating event network-changed:6e636562-656a-4e4d-8241-b867d69fdc72 for instance 92aed47a-39ca-4174-9ae4-b99c2fb029e1 on hv-cinder-85251 Aug 09 11:23:34.368524 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-16f62960-7122-4012-b330-f79c7e7526a0 req-7223ad94-c847-483d-9550-3e80d2a373d8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030560 Aug 09 11:23:34.369151 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 423/809] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:23:34.740854 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-9d6b7351-35a7-4684-aedb-18399a238365 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:34.742470 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-9d6b7351-35a7-4684-aedb-18399a238365 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:34.750373 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9d6b7351-35a7-4684-aedb-18399a238365 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:34.750917 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9d6b7351-35a7-4684-aedb-18399a238365 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:34.751344 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9d6b7351-35a7-4684-aedb-18399a238365 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:34.752084 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9d6b7351-35a7-4684-aedb-18399a238365 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:34.752558 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9d6b7351-35a7-4684-aedb-18399a238365 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:34.752977 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9d6b7351-35a7-4684-aedb-18399a238365 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:34.755739 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell1:SELECT=100 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:23:34.852140 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-9c118d82-571e-4ce1-839b-cbbf07affe58 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:34.853000 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-9c118d82-571e-4ce1-839b-cbbf07affe58 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 935b9a57-1104-4ad6-a0ba-3301edf35661] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:34.860119 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9c118d82-571e-4ce1-839b-cbbf07affe58 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:34.860611 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9c118d82-571e-4ce1-839b-cbbf07affe58 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:34.861214 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9c118d82-571e-4ce1-839b-cbbf07affe58 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:34.861926 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9c118d82-571e-4ce1-839b-cbbf07affe58 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:34.862370 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9c118d82-571e-4ce1-839b-cbbf07affe58 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:34.862918 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9c118d82-571e-4ce1-839b-cbbf07affe58 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:34.891318 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-9d6b7351-35a7-4684-aedb-18399a238365 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:34.900370 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-9d6b7351-35a7-4684-aedb-18399a238365 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1570 microversion: 2.1 time: 0.163412 Aug 09 11:23:34.901153 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 387/810] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:34 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:35.001633 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-9c118d82-571e-4ce1-839b-cbbf07affe58 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:35.009470 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-9c118d82-571e-4ce1-839b-cbbf07affe58 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661" status: 200 len: 1267 microversion: 2.1 time: 0.162206 Aug 09 11:23:35.010054 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 424/811] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:34 2022] GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:35.267725 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-303e6c64-26b2-4128-960c-2347adea987a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:35.268371 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-303e6c64-26b2-4128-960c-2347adea987a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:35.275234 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-303e6c64-26b2-4128-960c-2347adea987a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:35.275719 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-303e6c64-26b2-4128-960c-2347adea987a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:35.276155 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-303e6c64-26b2-4128-960c-2347adea987a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:35.276968 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-303e6c64-26b2-4128-960c-2347adea987a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:35.277422 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-303e6c64-26b2-4128-960c-2347adea987a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:35.277848 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-303e6c64-26b2-4128-960c-2347adea987a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:35.420566 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-303e6c64-26b2-4128-960c-2347adea987a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:35.428940 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-303e6c64-26b2-4128-960c-2347adea987a tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078" status: 200 len: 1722 microversion: 2.1 time: 0.165228 Aug 09 11:23:35.430239 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 388/812] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:35 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:35.790427 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-f66738dc-e32f-4deb-ab73-b425acd46779 req-cb5bec3d-d704-4d34-9b77-b16b62c903a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b683e1f9-1d37-46d4-a7a1-9f15b514336e", "name": "network-vif-unplugged", "status": "completed", "tag": "afc665af-24eb-4ff3-8263-bd971e0a7488"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:23:35.800739 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-f66738dc-e32f-4deb-ab73-b425acd46779 req-cb5bec3d-d704-4d34-9b77-b16b62c903a4 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:35.801525 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-f66738dc-e32f-4deb-ab73-b425acd46779 req-cb5bec3d-d704-4d34-9b77-b16b62c903a4 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:35.802071 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-f66738dc-e32f-4deb-ab73-b425acd46779 req-cb5bec3d-d704-4d34-9b77-b16b62c903a4 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:35.814549 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-f66738dc-e32f-4deb-ab73-b425acd46779 req-cb5bec3d-d704-4d34-9b77-b16b62c903a4 service nova] Creating event network-vif-unplugged:afc665af-24eb-4ff3-8263-bd971e0a7488 for instance b683e1f9-1d37-46d4-a7a1-9f15b514336e on hv-cinder-85251 Aug 09 11:23:35.820357 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-f66738dc-e32f-4deb-ab73-b425acd46779 req-cb5bec3d-d704-4d34-9b77-b16b62c903a4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033633 Aug 09 11:23:35.821127 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 425/813] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:23:35.922618 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-ccd0a147-f23e-44d4-87ae-57efac81d3dd tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:35.923159 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-ccd0a147-f23e-44d4-87ae-57efac81d3dd tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:35.929677 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ccd0a147-f23e-44d4-87ae-57efac81d3dd tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:35.930160 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ccd0a147-f23e-44d4-87ae-57efac81d3dd tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:35.930689 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ccd0a147-f23e-44d4-87ae-57efac81d3dd tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:35.931284 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ccd0a147-f23e-44d4-87ae-57efac81d3dd tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:35.931731 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ccd0a147-f23e-44d4-87ae-57efac81d3dd tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:35.932150 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ccd0a147-f23e-44d4-87ae-57efac81d3dd tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:36.031090 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-47fe72d0-7788-4b7e-8ba6-ebd6ccab889a tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:36.031786 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-47fe72d0-7788-4b7e-8ba6-ebd6ccab889a tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 935b9a57-1104-4ad6-a0ba-3301edf35661] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:36.038180 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-47fe72d0-7788-4b7e-8ba6-ebd6ccab889a tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:36.038662 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-47fe72d0-7788-4b7e-8ba6-ebd6ccab889a tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:36.039129 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-47fe72d0-7788-4b7e-8ba6-ebd6ccab889a tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:36.040157 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-47fe72d0-7788-4b7e-8ba6-ebd6ccab889a tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:36.040603 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-47fe72d0-7788-4b7e-8ba6-ebd6ccab889a tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:36.041054 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-47fe72d0-7788-4b7e-8ba6-ebd6ccab889a tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:36.067159 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-ccd0a147-f23e-44d4-87ae-57efac81d3dd tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:36.075351 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-ccd0a147-f23e-44d4-87ae-57efac81d3dd tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1571 microversion: 2.1 time: 0.156744 Aug 09 11:23:36.075927 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 389/814] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:35 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1571 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:36.095934 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-cfbff8fb-1803-4096-84ac-bc956b94cdb5 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:23:36.096554 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-cfbff8fb-1803-4096-84ac-bc956b94cdb5 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:36.102757 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cfbff8fb-1803-4096-84ac-bc956b94cdb5 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:36.103261 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cfbff8fb-1803-4096-84ac-bc956b94cdb5 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:36.103699 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cfbff8fb-1803-4096-84ac-bc956b94cdb5 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:36.104414 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cfbff8fb-1803-4096-84ac-bc956b94cdb5 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:36.104867 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cfbff8fb-1803-4096-84ac-bc956b94cdb5 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:36.105283 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cfbff8fb-1803-4096-84ac-bc956b94cdb5 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:36.157500 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-cfbff8fb-1803-4096-84ac-bc956b94cdb5 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117684) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 09 11:23:36.194197 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-47fe72d0-7788-4b7e-8ba6-ebd6ccab889a tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:36.220548 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-47fe72d0-7788-4b7e-8ba6-ebd6ccab889a tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661" status: 200 len: 1267 microversion: 2.1 time: 0.194152 Aug 09 11:23:36.221219 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 426/815] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:36 2022] GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661 => generated 1267 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:36.243065 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-cfbff8fb-1803-4096-84ac-bc956b94cdb5 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "POST /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e/action" status: 202 len: 0 microversion: 2.1 time: 0.150921 Aug 09 11:23:36.244327 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 390/816] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 9 11:23:36 2022] POST /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 11:23:36.254187 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-c765ebfd-7f9f-4a94-837d-5806db93907e tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:36.255020 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-c765ebfd-7f9f-4a94-837d-5806db93907e tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:36.261964 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c765ebfd-7f9f-4a94-837d-5806db93907e tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:36.262447 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c765ebfd-7f9f-4a94-837d-5806db93907e tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:36.262865 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c765ebfd-7f9f-4a94-837d-5806db93907e tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:36.263836 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c765ebfd-7f9f-4a94-837d-5806db93907e tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:36.264349 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c765ebfd-7f9f-4a94-837d-5806db93907e tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:36.264864 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c765ebfd-7f9f-4a94-837d-5806db93907e tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:36.451940 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-6c4f9591-c79a-4529-9285-e6686601088e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:36.453520 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-6c4f9591-c79a-4529-9285-e6686601088e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:36.456745 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-c765ebfd-7f9f-4a94-837d-5806db93907e tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:36.460323 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6c4f9591-c79a-4529-9285-e6686601088e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:36.460831 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6c4f9591-c79a-4529-9285-e6686601088e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:36.461258 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6c4f9591-c79a-4529-9285-e6686601088e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:36.462773 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6c4f9591-c79a-4529-9285-e6686601088e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:36.463294 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6c4f9591-c79a-4529-9285-e6686601088e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:36.463697 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6c4f9591-c79a-4529-9285-e6686601088e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:36.464655 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-c765ebfd-7f9f-4a94-837d-5806db93907e tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1579 microversion: 2.1 time: 0.215121 Aug 09 11:23:36.465424 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 427/817] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:36 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1579 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:36.607705 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-6c4f9591-c79a-4529-9285-e6686601088e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:36.616493 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-6c4f9591-c79a-4529-9285-e6686601088e tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078" status: 200 len: 1728 microversion: 2.1 time: 0.169190 Aug 09 11:23:36.617907 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 391/818] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:36 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:36.647343 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-57a14a43-32bf-4d72-9a9f-ebe0bc8e0d17 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:36.647883 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-57a14a43-32bf-4d72-9a9f-ebe0bc8e0d17 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:36.655279 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-57a14a43-32bf-4d72-9a9f-ebe0bc8e0d17 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:36.656552 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-57a14a43-32bf-4d72-9a9f-ebe0bc8e0d17 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:36.657011 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-57a14a43-32bf-4d72-9a9f-ebe0bc8e0d17 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:36.657800 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-57a14a43-32bf-4d72-9a9f-ebe0bc8e0d17 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:36.658299 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-57a14a43-32bf-4d72-9a9f-ebe0bc8e0d17 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:36.658719 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-57a14a43-32bf-4d72-9a9f-ebe0bc8e0d17 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:36.751313 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-57a14a43-32bf-4d72-9a9f-ebe0bc8e0d17 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.109106 Aug 09 11:23:36.752051 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 428/819] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Aug 9 11:23:36 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078/os-interface => generated 285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:23:37.242779 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-192c5c0d-ad28-4a72-a9f6-0298af50c502 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:37.243953 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-192c5c0d-ad28-4a72-a9f6-0298af50c502 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 935b9a57-1104-4ad6-a0ba-3301edf35661] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:37.251724 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-192c5c0d-ad28-4a72-a9f6-0298af50c502 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:37.252220 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-192c5c0d-ad28-4a72-a9f6-0298af50c502 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:37.252693 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-192c5c0d-ad28-4a72-a9f6-0298af50c502 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:37.253401 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-192c5c0d-ad28-4a72-a9f6-0298af50c502 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:37.253848 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-192c5c0d-ad28-4a72-a9f6-0298af50c502 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:37.254419 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-192c5c0d-ad28-4a72-a9f6-0298af50c502 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:37.487355 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-2f04c9ef-3bd1-4220-9176-771d3e9d618e tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:37.488373 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-2f04c9ef-3bd1-4220-9176-771d3e9d618e tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:37.495608 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2f04c9ef-3bd1-4220-9176-771d3e9d618e tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:37.496189 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2f04c9ef-3bd1-4220-9176-771d3e9d618e tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:37.496709 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2f04c9ef-3bd1-4220-9176-771d3e9d618e tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:37.497474 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2f04c9ef-3bd1-4220-9176-771d3e9d618e tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:37.497985 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2f04c9ef-3bd1-4220-9176-771d3e9d618e tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:37.498497 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2f04c9ef-3bd1-4220-9176-771d3e9d618e tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:37.775904 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-2f04c9ef-3bd1-4220-9176-771d3e9d618e tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:37.784141 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-192c5c0d-ad28-4a72-a9f6-0298af50c502 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:37.789032 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-2f04c9ef-3bd1-4220-9176-771d3e9d618e tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1521 microversion: 2.1 time: 0.305977 Aug 09 11:23:37.792047 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 429/820] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:37 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:37.795819 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-192c5c0d-ad28-4a72-a9f6-0298af50c502 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661" status: 200 len: 1267 microversion: 2.1 time: 0.556859 Aug 09 11:23:37.808898 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 392/821] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:37 2022] GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661 => generated 1267 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:38.112643 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-a6567c9c-fcf3-4ef0-a1df-38729c2141c6 req-b6c1d517-f702-49b5-aab2-d936cba7fbb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8009a1a2-4c8e-4953-ba5c-faab2db05078", "tag": "13fa53bd-98eb-4624-884c-1b14e8d98ae7"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:23:38.122669 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-a6567c9c-fcf3-4ef0-a1df-38729c2141c6 req-b6c1d517-f702-49b5-aab2-d936cba7fbb8 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:38.123413 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-a6567c9c-fcf3-4ef0-a1df-38729c2141c6 req-b6c1d517-f702-49b5-aab2-d936cba7fbb8 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:38.123837 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-a6567c9c-fcf3-4ef0-a1df-38729c2141c6 req-b6c1d517-f702-49b5-aab2-d936cba7fbb8 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:38.137451 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-a6567c9c-fcf3-4ef0-a1df-38729c2141c6 req-b6c1d517-f702-49b5-aab2-d936cba7fbb8 service nova] Creating event network-changed:13fa53bd-98eb-4624-884c-1b14e8d98ae7 for instance 8009a1a2-4c8e-4953-ba5c-faab2db05078 on hv-cinder-85251 Aug 09 11:23:38.142490 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-a6567c9c-fcf3-4ef0-a1df-38729c2141c6 req-b6c1d517-f702-49b5-aab2-d936cba7fbb8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033611 Aug 09 11:23:38.143081 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 430/822] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:23:38.811200 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-1b5fd710-1613-4c68-9806-cbe051def11f tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:38.817834 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-43e99803-8672-4d30-80a5-3f6352cc77d3 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:38.819126 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-1b5fd710-1613-4c68-9806-cbe051def11f tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:38.820078 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-43e99803-8672-4d30-80a5-3f6352cc77d3 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 935b9a57-1104-4ad6-a0ba-3301edf35661] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:38.824834 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:23:38.834333 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-43e99803-8672-4d30-80a5-3f6352cc77d3 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:38.835455 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-43e99803-8672-4d30-80a5-3f6352cc77d3 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:38.837386 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-43e99803-8672-4d30-80a5-3f6352cc77d3 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:38.839247 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-43e99803-8672-4d30-80a5-3f6352cc77d3 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:38.839958 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1b5fd710-1613-4c68-9806-cbe051def11f tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:38.840688 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-43e99803-8672-4d30-80a5-3f6352cc77d3 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:38.841360 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1b5fd710-1613-4c68-9806-cbe051def11f tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:38.841988 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-43e99803-8672-4d30-80a5-3f6352cc77d3 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:38.844568 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1b5fd710-1613-4c68-9806-cbe051def11f tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:38.845551 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1b5fd710-1613-4c68-9806-cbe051def11f tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:38.846204 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1b5fd710-1613-4c68-9806-cbe051def11f tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:38.846809 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1b5fd710-1613-4c68-9806-cbe051def11f tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:39.086478 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-1b5fd710-1613-4c68-9806-cbe051def11f tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:39.091759 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-43e99803-8672-4d30-80a5-3f6352cc77d3 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:39.094528 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-1b5fd710-1613-4c68-9806-cbe051def11f tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1577 microversion: 2.1 time: 0.287162 Aug 09 11:23:39.100258 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-43e99803-8672-4d30-80a5-3f6352cc77d3 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661" status: 200 len: 1267 microversion: 2.1 time: 0.286169 Aug 09 11:23:39.100258 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 431/823] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:38 2022] GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661 => generated 1267 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:39.107891 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 393/824] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:38 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1577 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:39.894972 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-160e20ce-44a9-4ae7-bff0-5bd49383ef65 req-6ad2509c-b7db-4626-97cd-99e6cbdb5391 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "935b9a57-1104-4ad6-a0ba-3301edf35661", "name": "network-vif-plugged", "status": "completed", "tag": "d9a273cd-bfdb-4a55-a1e8-c1fbe783a476"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:23:39.906672 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-160e20ce-44a9-4ae7-bff0-5bd49383ef65 req-6ad2509c-b7db-4626-97cd-99e6cbdb5391 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:39.907213 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-160e20ce-44a9-4ae7-bff0-5bd49383ef65 req-6ad2509c-b7db-4626-97cd-99e6cbdb5391 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:39.907780 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-160e20ce-44a9-4ae7-bff0-5bd49383ef65 req-6ad2509c-b7db-4626-97cd-99e6cbdb5391 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:39.919841 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-160e20ce-44a9-4ae7-bff0-5bd49383ef65 req-6ad2509c-b7db-4626-97cd-99e6cbdb5391 service nova] Creating event network-vif-plugged:d9a273cd-bfdb-4a55-a1e8-c1fbe783a476 for instance 935b9a57-1104-4ad6-a0ba-3301edf35661 on hv-cinder-85251 Aug 09 11:23:39.925240 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-160e20ce-44a9-4ae7-bff0-5bd49383ef65 req-6ad2509c-b7db-4626-97cd-99e6cbdb5391 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034134 Aug 09 11:23:39.926201 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 432/825] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:23:40.115957 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-406e7be2-3b15-4ab5-aad4-e23899ccb1b4 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:40.116716 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-406e7be2-3b15-4ab5-aad4-e23899ccb1b4 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:40.122229 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-9d85d649-88cb-4d86-9aa4-5b12c8404fa5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:40.122962 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-9d85d649-88cb-4d86-9aa4-5b12c8404fa5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 935b9a57-1104-4ad6-a0ba-3301edf35661] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:40.123964 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-406e7be2-3b15-4ab5-aad4-e23899ccb1b4 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:40.124507 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-406e7be2-3b15-4ab5-aad4-e23899ccb1b4 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:40.124940 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-406e7be2-3b15-4ab5-aad4-e23899ccb1b4 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:40.125628 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-406e7be2-3b15-4ab5-aad4-e23899ccb1b4 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:40.126254 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-406e7be2-3b15-4ab5-aad4-e23899ccb1b4 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:40.126979 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-406e7be2-3b15-4ab5-aad4-e23899ccb1b4 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:40.130403 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9d85d649-88cb-4d86-9aa4-5b12c8404fa5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:40.131102 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9d85d649-88cb-4d86-9aa4-5b12c8404fa5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:40.133347 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9d85d649-88cb-4d86-9aa4-5b12c8404fa5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:40.134249 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9d85d649-88cb-4d86-9aa4-5b12c8404fa5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:40.134837 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9d85d649-88cb-4d86-9aa4-5b12c8404fa5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:40.135259 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9d85d649-88cb-4d86-9aa4-5b12c8404fa5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:40.322903 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-9d85d649-88cb-4d86-9aa4-5b12c8404fa5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:40.330559 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-9d85d649-88cb-4d86-9aa4-5b12c8404fa5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661" status: 200 len: 1267 microversion: 2.1 time: 0.213595 Aug 09 11:23:40.331087 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 433/826] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:40 2022] GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661 => generated 1267 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:40.335508 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-fdabacf8-d6f2-4585-ac1a-ebd930dbbcbf req-bb8f0d28-5100-4b6d-8954-0184ad5d4f92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8009a1a2-4c8e-4953-ba5c-faab2db05078", "tag": "13fa53bd-98eb-4624-884c-1b14e8d98ae7"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:23:40.336655 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-406e7be2-3b15-4ab5-aad4-e23899ccb1b4 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:40.344593 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-406e7be2-3b15-4ab5-aad4-e23899ccb1b4 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1577 microversion: 2.1 time: 0.232587 Aug 09 11:23:40.345152 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 394/827] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:40 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1577 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:40.345793 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-fdabacf8-d6f2-4585-ac1a-ebd930dbbcbf req-bb8f0d28-5100-4b6d-8954-0184ad5d4f92 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:40.346290 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-fdabacf8-d6f2-4585-ac1a-ebd930dbbcbf req-bb8f0d28-5100-4b6d-8954-0184ad5d4f92 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:40.346717 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-fdabacf8-d6f2-4585-ac1a-ebd930dbbcbf req-bb8f0d28-5100-4b6d-8954-0184ad5d4f92 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:40.358459 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-fdabacf8-d6f2-4585-ac1a-ebd930dbbcbf req-bb8f0d28-5100-4b6d-8954-0184ad5d4f92 service nova] Creating event network-changed:13fa53bd-98eb-4624-884c-1b14e8d98ae7 for instance 8009a1a2-4c8e-4953-ba5c-faab2db05078 on hv-cinder-85251 Aug 09 11:23:40.363539 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-fdabacf8-d6f2-4585-ac1a-ebd930dbbcbf req-bb8f0d28-5100-4b6d-8954-0184ad5d4f92 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031348 Aug 09 11:23:40.364136 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 434/828] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:23:40.695092 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-c35c8426-03c7-46cf-9c57-acaf33fb6b53 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:40.695613 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-c35c8426-03c7-46cf-9c57-acaf33fb6b53 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:40.702669 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c35c8426-03c7-46cf-9c57-acaf33fb6b53 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:40.703228 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c35c8426-03c7-46cf-9c57-acaf33fb6b53 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:40.703665 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c35c8426-03c7-46cf-9c57-acaf33fb6b53 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:40.704896 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c35c8426-03c7-46cf-9c57-acaf33fb6b53 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:40.705350 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c35c8426-03c7-46cf-9c57-acaf33fb6b53 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:40.706266 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c35c8426-03c7-46cf-9c57-acaf33fb6b53 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:40.731157 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-c35c8426-03c7-46cf-9c57-acaf33fb6b53 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0/ips" status: 200 len: 152 microversion: 2.20 time: 0.142598 Aug 09 11:23:40.731739 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 395/829] 10.222.0.27 () {60 vars in 1289 bytes} [Tue Aug 9 11:23:40 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0/ips => generated 152 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 11:23:41.353206 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-4f205eb9-3dab-4508-b810-0a1a17a699c3 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:41.353903 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-4f205eb9-3dab-4508-b810-0a1a17a699c3 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 935b9a57-1104-4ad6-a0ba-3301edf35661] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:41.361470 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4f205eb9-3dab-4508-b810-0a1a17a699c3 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:41.361963 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4f205eb9-3dab-4508-b810-0a1a17a699c3 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:41.362391 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4f205eb9-3dab-4508-b810-0a1a17a699c3 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:41.363117 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4f205eb9-3dab-4508-b810-0a1a17a699c3 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:41.363556 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4f205eb9-3dab-4508-b810-0a1a17a699c3 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:41.363968 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4f205eb9-3dab-4508-b810-0a1a17a699c3 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:41.367036 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-000a7116-aab6-42a7-a205-7d5b454ba1ca tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:41.367863 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-000a7116-aab6-42a7-a205-7d5b454ba1ca tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:41.375477 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-000a7116-aab6-42a7-a205-7d5b454ba1ca tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:41.375994 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-000a7116-aab6-42a7-a205-7d5b454ba1ca tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:41.376454 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-000a7116-aab6-42a7-a205-7d5b454ba1ca tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:41.377168 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-000a7116-aab6-42a7-a205-7d5b454ba1ca tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:41.377750 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-000a7116-aab6-42a7-a205-7d5b454ba1ca tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:41.378188 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-000a7116-aab6-42a7-a205-7d5b454ba1ca tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:41.565523 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-4f205eb9-3dab-4508-b810-0a1a17a699c3 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:41.574994 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-4f205eb9-3dab-4508-b810-0a1a17a699c3 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661" status: 200 len: 1267 microversion: 2.1 time: 0.226680 Aug 09 11:23:41.575612 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 435/830] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:41 2022] GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661 => generated 1267 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:41.592904 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-000a7116-aab6-42a7-a205-7d5b454ba1ca tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:41.600602 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-000a7116-aab6-42a7-a205-7d5b454ba1ca tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1577 microversion: 2.1 time: 0.237938 Aug 09 11:23:41.601178 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 396/831] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:41 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1577 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:42.596850 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-be1d0e68-0439-49c3-b004-632d5f46d4fd tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:42.597461 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-be1d0e68-0439-49c3-b004-632d5f46d4fd tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 935b9a57-1104-4ad6-a0ba-3301edf35661] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:42.605433 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-be1d0e68-0439-49c3-b004-632d5f46d4fd tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:42.605981 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-be1d0e68-0439-49c3-b004-632d5f46d4fd tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:42.606420 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-be1d0e68-0439-49c3-b004-632d5f46d4fd tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:42.607119 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-be1d0e68-0439-49c3-b004-632d5f46d4fd tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:42.607567 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-be1d0e68-0439-49c3-b004-632d5f46d4fd tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:42.607992 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-be1d0e68-0439-49c3-b004-632d5f46d4fd tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:42.683861 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-9b417eb3-2217-4f28-a63e-bb24d5a0132f tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:42.685274 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-9b417eb3-2217-4f28-a63e-bb24d5a0132f tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:42.691978 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9b417eb3-2217-4f28-a63e-bb24d5a0132f tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:42.692499 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9b417eb3-2217-4f28-a63e-bb24d5a0132f tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:42.692927 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9b417eb3-2217-4f28-a63e-bb24d5a0132f tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:42.693987 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9b417eb3-2217-4f28-a63e-bb24d5a0132f tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:42.694730 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9b417eb3-2217-4f28-a63e-bb24d5a0132f tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:42.695132 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9b417eb3-2217-4f28-a63e-bb24d5a0132f tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:42.787715 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-be1d0e68-0439-49c3-b004-632d5f46d4fd tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:42.795745 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-be1d0e68-0439-49c3-b004-632d5f46d4fd tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661" status: 200 len: 1453 microversion: 2.1 time: 0.203467 Aug 09 11:23:42.796352 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 436/832] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:42 2022] GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661 => generated 1453 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:42.801142 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-a312a365-7de0-4827-b159-9dbf4f1e6d41 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:23:42.801668 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-a312a365-7de0-4827-b159-9dbf4f1e6d41 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:42.807638 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a312a365-7de0-4827-b159-9dbf4f1e6d41 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:42.808234 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a312a365-7de0-4827-b159-9dbf4f1e6d41 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:42.808752 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a312a365-7de0-4827-b159-9dbf4f1e6d41 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:42.809453 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a312a365-7de0-4827-b159-9dbf4f1e6d41 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:42.809902 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a312a365-7de0-4827-b159-9dbf4f1e6d41 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:42.810323 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a312a365-7de0-4827-b159-9dbf4f1e6d41 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:42.835352 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.objects.instance [None req-a312a365-7de0-4827-b159-9dbf4f1e6d41 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lazy-loading 'flavor' on Instance uuid 919c3009-894a-45e2-bc25-24df397fa3d0 {{(pid=117685) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:23:42.854846 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-9b417eb3-2217-4f28-a63e-bb24d5a0132f tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:42.864403 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-9b417eb3-2217-4f28-a63e-bb24d5a0132f tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1577 microversion: 2.1 time: 0.184657 Aug 09 11:23:42.864986 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 397/833] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:42 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1577 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:42.869539 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-5f86f8ea-5cd9-455a-b30e-6b6329f7a881 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:42.870147 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-5f86f8ea-5cd9-455a-b30e-6b6329f7a881 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 935b9a57-1104-4ad6-a0ba-3301edf35661] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:42.876219 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5f86f8ea-5cd9-455a-b30e-6b6329f7a881 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:42.876758 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5f86f8ea-5cd9-455a-b30e-6b6329f7a881 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:42.877195 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5f86f8ea-5cd9-455a-b30e-6b6329f7a881 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:42.877893 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5f86f8ea-5cd9-455a-b30e-6b6329f7a881 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:42.878340 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5f86f8ea-5cd9-455a-b30e-6b6329f7a881 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:42.878985 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5f86f8ea-5cd9-455a-b30e-6b6329f7a881 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:42.900403 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:23:43.021708 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-5f86f8ea-5cd9-455a-b30e-6b6329f7a881 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:43.025265 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-a312a365-7de0-4827-b159-9dbf4f1e6d41 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "POST /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0/action" status: 202 len: 0 microversion: 2.20 time: 0.227655 Aug 09 11:23:43.025968 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 437/834] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Aug 9 11:23:42 2022] POST /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 11:23:43.030236 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-5f86f8ea-5cd9-455a-b30e-6b6329f7a881 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661" status: 200 len: 1453 microversion: 2.1 time: 0.164245 Aug 09 11:23:43.030906 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 398/835] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:42 2022] GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661 => generated 1453 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:43.035569 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-a2671113-1a7b-4e9a-952d-2dcee35f165a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:43.036293 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-a2671113-1a7b-4e9a-952d-2dcee35f165a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:43.042625 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a2671113-1a7b-4e9a-952d-2dcee35f165a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:43.043103 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a2671113-1a7b-4e9a-952d-2dcee35f165a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:43.043666 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a2671113-1a7b-4e9a-952d-2dcee35f165a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:43.044402 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a2671113-1a7b-4e9a-952d-2dcee35f165a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:43.044876 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a2671113-1a7b-4e9a-952d-2dcee35f165a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:43.045330 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a2671113-1a7b-4e9a-952d-2dcee35f165a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:43.218807 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-a2671113-1a7b-4e9a-952d-2dcee35f165a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:43.227184 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-a2671113-1a7b-4e9a-952d-2dcee35f165a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:43.228777 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-a2671113-1a7b-4e9a-952d-2dcee35f165a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:43.229944 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-a2671113-1a7b-4e9a-952d-2dcee35f165a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1724 microversion: 2.20 time: 0.198870 Aug 09 11:23:43.230477 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 438/836] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:23:43 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 11:23:43.887139 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-dae20c36-3676-4a37-abea-335b8abe6e14 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:43.887846 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-dae20c36-3676-4a37-abea-335b8abe6e14 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:43.894470 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-dae20c36-3676-4a37-abea-335b8abe6e14 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:43.894944 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-dae20c36-3676-4a37-abea-335b8abe6e14 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:43.895374 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-dae20c36-3676-4a37-abea-335b8abe6e14 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:43.896382 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-dae20c36-3676-4a37-abea-335b8abe6e14 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:43.896860 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-dae20c36-3676-4a37-abea-335b8abe6e14 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:43.897275 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-dae20c36-3676-4a37-abea-335b8abe6e14 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:44.036508 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-dae20c36-3676-4a37-abea-335b8abe6e14 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:44.044774 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-dae20c36-3676-4a37-abea-335b8abe6e14 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1577 microversion: 2.1 time: 0.162320 Aug 09 11:23:44.045377 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 399/837] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:43 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:44.253126 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-b45be352-5b87-4e42-8342-0b37f35d72f9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:44.253717 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-b45be352-5b87-4e42-8342-0b37f35d72f9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:44.260730 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b45be352-5b87-4e42-8342-0b37f35d72f9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:44.261220 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b45be352-5b87-4e42-8342-0b37f35d72f9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:44.261655 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b45be352-5b87-4e42-8342-0b37f35d72f9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:44.262355 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b45be352-5b87-4e42-8342-0b37f35d72f9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:44.262798 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b45be352-5b87-4e42-8342-0b37f35d72f9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:44.263222 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b45be352-5b87-4e42-8342-0b37f35d72f9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:44.399650 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-b45be352-5b87-4e42-8342-0b37f35d72f9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:44.408078 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-b45be352-5b87-4e42-8342-0b37f35d72f9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:44.409606 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-b45be352-5b87-4e42-8342-0b37f35d72f9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:44.410797 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-b45be352-5b87-4e42-8342-0b37f35d72f9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1724 microversion: 2.20 time: 0.161643 Aug 09 11:23:44.411326 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 439/838] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:23:44 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:23:45.010493 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [req-dc711cc8-e36f-4f34-8601-79457e3dd704 req-f2cebaf6-65ca-422d-b677-2e6174ddb993 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "935b9a57-1104-4ad6-a0ba-3301edf35661", "tag": "d9a273cd-bfdb-4a55-a1e8-c1fbe783a476"}]} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:23:45.020612 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-dc711cc8-e36f-4f34-8601-79457e3dd704 req-f2cebaf6-65ca-422d-b677-2e6174ddb993 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:45.021428 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-dc711cc8-e36f-4f34-8601-79457e3dd704 req-f2cebaf6-65ca-422d-b677-2e6174ddb993 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:45.021855 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-dc711cc8-e36f-4f34-8601-79457e3dd704 req-f2cebaf6-65ca-422d-b677-2e6174ddb993 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:45.034807 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.compute.server_external_events [req-dc711cc8-e36f-4f34-8601-79457e3dd704 req-f2cebaf6-65ca-422d-b677-2e6174ddb993 service nova] Creating event network-changed:d9a273cd-bfdb-4a55-a1e8-c1fbe783a476 for instance 935b9a57-1104-4ad6-a0ba-3301edf35661 on hv-cinder-85251 Aug 09 11:23:45.040042 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [req-dc711cc8-e36f-4f34-8601-79457e3dd704 req-f2cebaf6-65ca-422d-b677-2e6174ddb993 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033444 Aug 09 11:23:45.040690 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 400/839] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:23:45.066110 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-f5e37e66-d9f9-4c10-9276-f961efd296e1 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:45.066889 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-f5e37e66-d9f9-4c10-9276-f961efd296e1 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:45.073207 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f5e37e66-d9f9-4c10-9276-f961efd296e1 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:45.073695 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f5e37e66-d9f9-4c10-9276-f961efd296e1 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:45.074164 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f5e37e66-d9f9-4c10-9276-f961efd296e1 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:45.074866 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f5e37e66-d9f9-4c10-9276-f961efd296e1 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:45.075311 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f5e37e66-d9f9-4c10-9276-f961efd296e1 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:45.075734 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f5e37e66-d9f9-4c10-9276-f961efd296e1 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:45.211870 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-f5e37e66-d9f9-4c10-9276-f961efd296e1 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:45.220138 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-f5e37e66-d9f9-4c10-9276-f961efd296e1 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1577 microversion: 2.1 time: 0.158068 Aug 09 11:23:45.220760 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 440/840] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:45 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:45.434437 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-5098fdb7-49a7-4b01-9b19-47fbe47421f5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:45.435141 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-5098fdb7-49a7-4b01-9b19-47fbe47421f5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:45.441468 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5098fdb7-49a7-4b01-9b19-47fbe47421f5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:45.441951 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5098fdb7-49a7-4b01-9b19-47fbe47421f5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:45.442598 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5098fdb7-49a7-4b01-9b19-47fbe47421f5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:45.443322 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5098fdb7-49a7-4b01-9b19-47fbe47421f5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:45.443760 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5098fdb7-49a7-4b01-9b19-47fbe47421f5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:45.444392 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5098fdb7-49a7-4b01-9b19-47fbe47421f5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:45.581237 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-5098fdb7-49a7-4b01-9b19-47fbe47421f5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:45.590461 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-5098fdb7-49a7-4b01-9b19-47fbe47421f5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:45.591945 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-5098fdb7-49a7-4b01-9b19-47fbe47421f5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:45.593147 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-5098fdb7-49a7-4b01-9b19-47fbe47421f5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1724 microversion: 2.20 time: 0.163129 Aug 09 11:23:45.603793 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 401/841] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:23:45 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:23:46.241643 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-557570b0-cb28-4acc-8140-43b06509f73d tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:46.242254 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-557570b0-cb28-4acc-8140-43b06509f73d tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:46.249287 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-557570b0-cb28-4acc-8140-43b06509f73d tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:46.249791 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-557570b0-cb28-4acc-8140-43b06509f73d tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:46.250217 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-557570b0-cb28-4acc-8140-43b06509f73d tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:46.250897 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-557570b0-cb28-4acc-8140-43b06509f73d tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:46.251340 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-557570b0-cb28-4acc-8140-43b06509f73d tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:46.251758 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-557570b0-cb28-4acc-8140-43b06509f73d tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:46.390746 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-557570b0-cb28-4acc-8140-43b06509f73d tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:46.399292 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-557570b0-cb28-4acc-8140-43b06509f73d tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1577 microversion: 2.1 time: 0.161603 Aug 09 11:23:46.399855 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 441/842] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:46 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:46.620452 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-79dd12e2-007d-4502-92ff-50360137ef45 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:46.621056 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-79dd12e2-007d-4502-92ff-50360137ef45 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:46.629113 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-79dd12e2-007d-4502-92ff-50360137ef45 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:46.629680 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-79dd12e2-007d-4502-92ff-50360137ef45 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:46.630188 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-79dd12e2-007d-4502-92ff-50360137ef45 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:46.630996 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-79dd12e2-007d-4502-92ff-50360137ef45 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:46.631548 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-79dd12e2-007d-4502-92ff-50360137ef45 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:46.632045 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-79dd12e2-007d-4502-92ff-50360137ef45 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:46.773248 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-79dd12e2-007d-4502-92ff-50360137ef45 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:46.782376 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-79dd12e2-007d-4502-92ff-50360137ef45 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:46.783870 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-79dd12e2-007d-4502-92ff-50360137ef45 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:46.785114 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-79dd12e2-007d-4502-92ff-50360137ef45 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1724 microversion: 2.20 time: 0.171191 Aug 09 11:23:46.785715 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 402/843] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:23:46 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:23:47.429686 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-c088daa6-ce1a-4132-8482-a655e7cfc35e tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:47.430427 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-c088daa6-ce1a-4132-8482-a655e7cfc35e tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:47.437541 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c088daa6-ce1a-4132-8482-a655e7cfc35e tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:47.438018 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c088daa6-ce1a-4132-8482-a655e7cfc35e tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:47.438467 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c088daa6-ce1a-4132-8482-a655e7cfc35e tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:47.439146 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c088daa6-ce1a-4132-8482-a655e7cfc35e tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:47.439591 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c088daa6-ce1a-4132-8482-a655e7cfc35e tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:47.440007 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c088daa6-ce1a-4132-8482-a655e7cfc35e tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:47.575767 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-c088daa6-ce1a-4132-8482-a655e7cfc35e tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:47.583484 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-c088daa6-ce1a-4132-8482-a655e7cfc35e tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1577 microversion: 2.1 time: 0.158767 Aug 09 11:23:47.584061 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 442/844] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:47 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:47.808957 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-b6850bf6-1e1a-4950-883d-cb223915bdc1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:47.809574 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-b6850bf6-1e1a-4950-883d-cb223915bdc1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:47.816051 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b6850bf6-1e1a-4950-883d-cb223915bdc1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:47.816569 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b6850bf6-1e1a-4950-883d-cb223915bdc1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:47.816974 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b6850bf6-1e1a-4950-883d-cb223915bdc1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:47.817694 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b6850bf6-1e1a-4950-883d-cb223915bdc1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:47.818141 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b6850bf6-1e1a-4950-883d-cb223915bdc1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:47.818553 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b6850bf6-1e1a-4950-883d-cb223915bdc1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:47.953411 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-b6850bf6-1e1a-4950-883d-cb223915bdc1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:47.956091 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:23:47.963674 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-b6850bf6-1e1a-4950-883d-cb223915bdc1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:47.965234 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-b6850bf6-1e1a-4950-883d-cb223915bdc1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:47.966397 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-b6850bf6-1e1a-4950-883d-cb223915bdc1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1724 microversion: 2.20 time: 0.161515 Aug 09 11:23:47.966959 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 403/845] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:23:47 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:23:48.606491 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-e93671fa-0398-4114-b3d7-c9b7f6095453 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:48.607061 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-e93671fa-0398-4114-b3d7-c9b7f6095453 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:48.613861 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e93671fa-0398-4114-b3d7-c9b7f6095453 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:48.614349 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e93671fa-0398-4114-b3d7-c9b7f6095453 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:48.614783 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e93671fa-0398-4114-b3d7-c9b7f6095453 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:48.615479 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e93671fa-0398-4114-b3d7-c9b7f6095453 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:48.615924 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e93671fa-0398-4114-b3d7-c9b7f6095453 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:48.616379 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e93671fa-0398-4114-b3d7-c9b7f6095453 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:48.753964 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-e93671fa-0398-4114-b3d7-c9b7f6095453 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:48.762143 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-e93671fa-0398-4114-b3d7-c9b7f6095453 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1577 microversion: 2.1 time: 0.160508 Aug 09 11:23:48.762680 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 443/846] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:48 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:48.991654 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-4cd8db1b-566c-4962-8b8f-fc305e03542b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:48.992551 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-4cd8db1b-566c-4962-8b8f-fc305e03542b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:49.000564 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4cd8db1b-566c-4962-8b8f-fc305e03542b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:49.001204 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4cd8db1b-566c-4962-8b8f-fc305e03542b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:49.001632 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4cd8db1b-566c-4962-8b8f-fc305e03542b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:49.002315 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4cd8db1b-566c-4962-8b8f-fc305e03542b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:49.002756 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4cd8db1b-566c-4962-8b8f-fc305e03542b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:49.003169 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4cd8db1b-566c-4962-8b8f-fc305e03542b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:49.133508 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-4cd8db1b-566c-4962-8b8f-fc305e03542b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:49.142110 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-4cd8db1b-566c-4962-8b8f-fc305e03542b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:49.143588 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-4cd8db1b-566c-4962-8b8f-fc305e03542b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:49.144861 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-4cd8db1b-566c-4962-8b8f-fc305e03542b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1724 microversion: 2.20 time: 0.158268 Aug 09 11:23:49.145497 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 404/847] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:23:48 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:23:49.783649 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-d35e4d35-1b34-428a-9ba3-0d4457b34656 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:49.784255 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-d35e4d35-1b34-428a-9ba3-0d4457b34656 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:49.791122 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d35e4d35-1b34-428a-9ba3-0d4457b34656 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:49.791665 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d35e4d35-1b34-428a-9ba3-0d4457b34656 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:49.792161 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d35e4d35-1b34-428a-9ba3-0d4457b34656 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:49.792897 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d35e4d35-1b34-428a-9ba3-0d4457b34656 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:49.793339 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d35e4d35-1b34-428a-9ba3-0d4457b34656 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:49.793757 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d35e4d35-1b34-428a-9ba3-0d4457b34656 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:49.928239 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-d35e4d35-1b34-428a-9ba3-0d4457b34656 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:49.934305 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [req-51f727f1-b795-4dd8-904e-a8052dc13381 req-77b5d343-8a58-4b15-9907-ccda5f2df47c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b683e1f9-1d37-46d4-a7a1-9f15b514336e", "name": "network-vif-plugged", "status": "completed", "tag": "afc665af-24eb-4ff3-8263-bd971e0a7488"}]} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:23:49.937277 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-d35e4d35-1b34-428a-9ba3-0d4457b34656 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1577 microversion: 2.1 time: 0.157584 Aug 09 11:23:49.937829 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 444/848] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:49 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:23:49.945367 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-51f727f1-b795-4dd8-904e-a8052dc13381 req-77b5d343-8a58-4b15-9907-ccda5f2df47c service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:49.946080 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-51f727f1-b795-4dd8-904e-a8052dc13381 req-77b5d343-8a58-4b15-9907-ccda5f2df47c service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:49.946774 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-51f727f1-b795-4dd8-904e-a8052dc13381 req-77b5d343-8a58-4b15-9907-ccda5f2df47c service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:49.960635 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.compute.server_external_events [req-51f727f1-b795-4dd8-904e-a8052dc13381 req-77b5d343-8a58-4b15-9907-ccda5f2df47c service nova] Creating event network-vif-plugged:afc665af-24eb-4ff3-8263-bd971e0a7488 for instance b683e1f9-1d37-46d4-a7a1-9f15b514336e on hv-cinder-85251 Aug 09 11:23:49.966087 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [req-51f727f1-b795-4dd8-904e-a8052dc13381 req-77b5d343-8a58-4b15-9907-ccda5f2df47c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035362 Aug 09 11:23:49.966693 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 405/849] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:23:50.168885 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-e2f0b167-7300-41ac-bde5-b3d17c261a1f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:50.169486 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-e2f0b167-7300-41ac-bde5-b3d17c261a1f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:50.175614 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e2f0b167-7300-41ac-bde5-b3d17c261a1f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:50.176095 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e2f0b167-7300-41ac-bde5-b3d17c261a1f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:50.176652 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e2f0b167-7300-41ac-bde5-b3d17c261a1f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:50.177350 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e2f0b167-7300-41ac-bde5-b3d17c261a1f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:50.177788 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e2f0b167-7300-41ac-bde5-b3d17c261a1f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:50.178212 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e2f0b167-7300-41ac-bde5-b3d17c261a1f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:50.314747 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-e2f0b167-7300-41ac-bde5-b3d17c261a1f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:50.322980 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-e2f0b167-7300-41ac-bde5-b3d17c261a1f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:50.324742 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-e2f0b167-7300-41ac-bde5-b3d17c261a1f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:50.325943 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-e2f0b167-7300-41ac-bde5-b3d17c261a1f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1724 microversion: 2.20 time: 0.161256 Aug 09 11:23:50.326506 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 445/850] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:23:50 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:23:50.959975 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-2e434cb0-37f6-48ba-8727-5219446c0dfb tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:50.960640 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-2e434cb0-37f6-48ba-8727-5219446c0dfb tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:50.968036 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2e434cb0-37f6-48ba-8727-5219446c0dfb tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:50.968551 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2e434cb0-37f6-48ba-8727-5219446c0dfb tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:50.968984 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2e434cb0-37f6-48ba-8727-5219446c0dfb tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:50.969707 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2e434cb0-37f6-48ba-8727-5219446c0dfb tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:50.970161 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2e434cb0-37f6-48ba-8727-5219446c0dfb tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:50.970580 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2e434cb0-37f6-48ba-8727-5219446c0dfb tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:51.107873 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-2e434cb0-37f6-48ba-8727-5219446c0dfb tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:51.119684 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-2e434cb0-37f6-48ba-8727-5219446c0dfb tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1577 microversion: 2.1 time: 0.163716 Aug 09 11:23:51.120261 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 406/851] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:50 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:51.348752 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-bfe72527-c983-4652-9e44-0a7277489ff1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:51.349370 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-bfe72527-c983-4652-9e44-0a7277489ff1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:51.356578 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bfe72527-c983-4652-9e44-0a7277489ff1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:51.357066 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bfe72527-c983-4652-9e44-0a7277489ff1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:51.357499 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bfe72527-c983-4652-9e44-0a7277489ff1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:51.358195 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bfe72527-c983-4652-9e44-0a7277489ff1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:51.358642 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bfe72527-c983-4652-9e44-0a7277489ff1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:51.359061 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bfe72527-c983-4652-9e44-0a7277489ff1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:51.494763 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-bfe72527-c983-4652-9e44-0a7277489ff1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:51.503225 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-bfe72527-c983-4652-9e44-0a7277489ff1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:51.504764 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-bfe72527-c983-4652-9e44-0a7277489ff1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:51.505956 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-bfe72527-c983-4652-9e44-0a7277489ff1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1724 microversion: 2.20 time: 0.161275 Aug 09 11:23:51.506517 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 446/852] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:23:51 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:23:52.153495 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-265379af-153e-4331-8db2-5183aed15a43 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:52.154423 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-265379af-153e-4331-8db2-5183aed15a43 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:52.165547 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-265379af-153e-4331-8db2-5183aed15a43 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:52.166353 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-265379af-153e-4331-8db2-5183aed15a43 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:52.167375 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-265379af-153e-4331-8db2-5183aed15a43 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:52.168001 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-265379af-153e-4331-8db2-5183aed15a43 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:52.168484 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-265379af-153e-4331-8db2-5183aed15a43 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:52.168958 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-265379af-153e-4331-8db2-5183aed15a43 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:52.311811 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-265379af-153e-4331-8db2-5183aed15a43 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:52.319840 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-265379af-153e-4331-8db2-5183aed15a43 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1564 microversion: 2.1 time: 0.173656 Aug 09 11:23:52.320477 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 407/853] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:23:52 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1564 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:52.531905 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-01ce37f6-78bd-4f00-9bd2-267fa65f1ace tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:52.532533 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-01ce37f6-78bd-4f00-9bd2-267fa65f1ace tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:52.539724 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-01ce37f6-78bd-4f00-9bd2-267fa65f1ace tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:52.540215 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-01ce37f6-78bd-4f00-9bd2-267fa65f1ace tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:52.540683 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-01ce37f6-78bd-4f00-9bd2-267fa65f1ace tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:52.541370 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-01ce37f6-78bd-4f00-9bd2-267fa65f1ace tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:52.541988 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-01ce37f6-78bd-4f00-9bd2-267fa65f1ace tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:52.542761 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-01ce37f6-78bd-4f00-9bd2-267fa65f1ace tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:52.681147 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-01ce37f6-78bd-4f00-9bd2-267fa65f1ace tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:52.689803 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-01ce37f6-78bd-4f00-9bd2-267fa65f1ace tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:52.691283 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-01ce37f6-78bd-4f00-9bd2-267fa65f1ace tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:52.692466 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-01ce37f6-78bd-4f00-9bd2-267fa65f1ace tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1724 microversion: 2.20 time: 0.165646 Aug 09 11:23:52.692991 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 447/854] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:23:52 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:23:53.719499 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-776d7513-2506-4c6f-98b1-8202a15fe6aa tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:53.720485 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-776d7513-2506-4c6f-98b1-8202a15fe6aa tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:53.730797 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-776d7513-2506-4c6f-98b1-8202a15fe6aa tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:53.731274 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-776d7513-2506-4c6f-98b1-8202a15fe6aa tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:53.731698 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-776d7513-2506-4c6f-98b1-8202a15fe6aa tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:53.732411 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-776d7513-2506-4c6f-98b1-8202a15fe6aa tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:53.732855 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-776d7513-2506-4c6f-98b1-8202a15fe6aa tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:53.733268 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-776d7513-2506-4c6f-98b1-8202a15fe6aa tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:54.027259 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-776d7513-2506-4c6f-98b1-8202a15fe6aa tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:54.035753 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-776d7513-2506-4c6f-98b1-8202a15fe6aa tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:54.037269 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-776d7513-2506-4c6f-98b1-8202a15fe6aa tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:54.038418 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-776d7513-2506-4c6f-98b1-8202a15fe6aa tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1724 microversion: 2.20 time: 0.325909 Aug 09 11:23:54.038975 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 408/855] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:23:53 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1724 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:23:55.062462 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-b4b0122b-aed5-4dc2-a15a-8d5123f299f3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:55.063023 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-b4b0122b-aed5-4dc2-a15a-8d5123f299f3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:55.065731 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_api:SELECT=90 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:23:55.071105 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b4b0122b-aed5-4dc2-a15a-8d5123f299f3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:55.071718 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b4b0122b-aed5-4dc2-a15a-8d5123f299f3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:55.072065 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b4b0122b-aed5-4dc2-a15a-8d5123f299f3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:55.072904 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b4b0122b-aed5-4dc2-a15a-8d5123f299f3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:55.073316 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b4b0122b-aed5-4dc2-a15a-8d5123f299f3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:55.073799 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-b4b0122b-aed5-4dc2-a15a-8d5123f299f3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:55.239081 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-b4b0122b-aed5-4dc2-a15a-8d5123f299f3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:55.249994 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-b4b0122b-aed5-4dc2-a15a-8d5123f299f3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:55.252387 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-b4b0122b-aed5-4dc2-a15a-8d5123f299f3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:55.254142 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-b4b0122b-aed5-4dc2-a15a-8d5123f299f3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1724 microversion: 2.20 time: 0.195524 Aug 09 11:23:55.254704 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 448/856] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:23:55 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:23:56.285389 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-26f4428b-acc3-4b0b-9dcf-4b506fab2883 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:56.286085 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-26f4428b-acc3-4b0b-9dcf-4b506fab2883 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:56.296174 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-26f4428b-acc3-4b0b-9dcf-4b506fab2883 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:56.296911 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-26f4428b-acc3-4b0b-9dcf-4b506fab2883 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:56.297495 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-26f4428b-acc3-4b0b-9dcf-4b506fab2883 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:56.298460 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-26f4428b-acc3-4b0b-9dcf-4b506fab2883 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:56.299101 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-26f4428b-acc3-4b0b-9dcf-4b506fab2883 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:56.299717 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-26f4428b-acc3-4b0b-9dcf-4b506fab2883 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:56.438273 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-26f4428b-acc3-4b0b-9dcf-4b506fab2883 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:56.450209 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-26f4428b-acc3-4b0b-9dcf-4b506fab2883 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:56.452579 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-26f4428b-acc3-4b0b-9dcf-4b506fab2883 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:56.454293 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-26f4428b-acc3-4b0b-9dcf-4b506fab2883 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1724 microversion: 2.20 time: 0.172549 Aug 09 11:23:56.455004 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 409/857] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:23:56 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:23:57.483681 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-0478d633-9a6a-4b2b-b6ea-af957750bd3c tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:57.484286 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-0478d633-9a6a-4b2b-b6ea-af957750bd3c tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:57.491318 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0478d633-9a6a-4b2b-b6ea-af957750bd3c tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:57.491760 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0478d633-9a6a-4b2b-b6ea-af957750bd3c tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:57.492190 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0478d633-9a6a-4b2b-b6ea-af957750bd3c tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:57.492918 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0478d633-9a6a-4b2b-b6ea-af957750bd3c tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:57.493367 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0478d633-9a6a-4b2b-b6ea-af957750bd3c tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:57.493785 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0478d633-9a6a-4b2b-b6ea-af957750bd3c tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:57.624566 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-0478d633-9a6a-4b2b-b6ea-af957750bd3c tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:57.633265 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-0478d633-9a6a-4b2b-b6ea-af957750bd3c tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:57.634773 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-0478d633-9a6a-4b2b-b6ea-af957750bd3c tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:57.636139 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-0478d633-9a6a-4b2b-b6ea-af957750bd3c tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1724 microversion: 2.20 time: 0.157043 Aug 09 11:23:57.636591 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 449/858] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:23:57 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:23:58.575196 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-c086b915-2996-4e45-8826-19af1477a429 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:58.576068 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-c086b915-2996-4e45-8826-19af1477a429 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: 6c6b7435-b965-416a-ae82-7eb037cc7152] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:58.586944 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c086b915-2996-4e45-8826-19af1477a429 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:58.587738 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c086b915-2996-4e45-8826-19af1477a429 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:58.588491 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c086b915-2996-4e45-8826-19af1477a429 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:58.589631 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c086b915-2996-4e45-8826-19af1477a429 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:58.590081 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c086b915-2996-4e45-8826-19af1477a429 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:58.590497 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c086b915-2996-4e45-8826-19af1477a429 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:58.614124 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-c086b915-2996-4e45-8826-19af1477a429 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152/ips" status: 200 len: 147 microversion: 2.1 time: 0.045802 Aug 09 11:23:58.614677 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 410/859] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Aug 9 11:23:58 2022] GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152/ips => generated 147 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:23:58.659113 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-a79ea5f7-4611-4d31-87d3-5eab9fc4af1b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:58.661343 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-a79ea5f7-4611-4d31-87d3-5eab9fc4af1b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:58.667980 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a79ea5f7-4611-4d31-87d3-5eab9fc4af1b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:58.668556 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a79ea5f7-4611-4d31-87d3-5eab9fc4af1b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:58.668984 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a79ea5f7-4611-4d31-87d3-5eab9fc4af1b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:58.669669 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a79ea5f7-4611-4d31-87d3-5eab9fc4af1b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:58.670110 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a79ea5f7-4611-4d31-87d3-5eab9fc4af1b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:58.670518 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a79ea5f7-4611-4d31-87d3-5eab9fc4af1b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:58.811014 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-a79ea5f7-4611-4d31-87d3-5eab9fc4af1b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:58.820133 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-a79ea5f7-4611-4d31-87d3-5eab9fc4af1b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:58.821754 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-a79ea5f7-4611-4d31-87d3-5eab9fc4af1b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:23:58.822917 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-a79ea5f7-4611-4d31-87d3-5eab9fc4af1b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1724 microversion: 2.20 time: 0.167877 Aug 09 11:23:58.823498 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 450/860] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:23:58 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:23:59.846391 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-60aa2406-260d-48ac-8dd2-8d973098467b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:59.846977 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-60aa2406-260d-48ac-8dd2-8d973098467b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:59.853833 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-60aa2406-260d-48ac-8dd2-8d973098467b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:59.854314 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-60aa2406-260d-48ac-8dd2-8d973098467b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:59.854751 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-60aa2406-260d-48ac-8dd2-8d973098467b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:59.855556 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-60aa2406-260d-48ac-8dd2-8d973098467b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:59.856007 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-60aa2406-260d-48ac-8dd2-8d973098467b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:59.856466 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-60aa2406-260d-48ac-8dd2-8d973098467b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:59.977616 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-6749399c-dba3-4929-83ee-cc626eb4e981 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09e8db26-d6cc-4931-9280-1e2fb5ae0ec8"}} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:23:59.980908 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-6749399c-dba3-4929-83ee-cc626eb4e981 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: 6c6b7435-b965-416a-ae82-7eb037cc7152] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:23:59.988159 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6749399c-dba3-4929-83ee-cc626eb4e981 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:59.988918 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6749399c-dba3-4929-83ee-cc626eb4e981 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:59.989580 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6749399c-dba3-4929-83ee-cc626eb4e981 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:59.990278 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6749399c-dba3-4929-83ee-cc626eb4e981 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:59.990922 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6749399c-dba3-4929-83ee-cc626eb4e981 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:59.991528 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6749399c-dba3-4929-83ee-cc626eb4e981 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:59.996364 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-60aa2406-260d-48ac-8dd2-8d973098467b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:00.006061 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-60aa2406-260d-48ac-8dd2-8d973098467b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:00.007550 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-60aa2406-260d-48ac-8dd2-8d973098467b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:00.008730 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-60aa2406-260d-48ac-8dd2-8d973098467b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1745 microversion: 2.20 time: 0.166409 Aug 09 11:24:00.009276 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 411/861] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:23:59 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1745 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:24:00.278754 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-6749399c-dba3-4929-83ee-cc626eb4e981 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "POST /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305106 Aug 09 11:24:00.279382 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 451/862] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Aug 9 11:23:59 2022] POST /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:24:01.033759 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-84579191-20b2-446f-9818-72c57f32e2cd tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:01.034398 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-84579191-20b2-446f-9818-72c57f32e2cd tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:01.041417 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-84579191-20b2-446f-9818-72c57f32e2cd tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:01.041906 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-84579191-20b2-446f-9818-72c57f32e2cd tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:01.042344 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-84579191-20b2-446f-9818-72c57f32e2cd tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:01.043038 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-84579191-20b2-446f-9818-72c57f32e2cd tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:01.043486 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-84579191-20b2-446f-9818-72c57f32e2cd tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:01.043909 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-84579191-20b2-446f-9818-72c57f32e2cd tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:01.182288 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-84579191-20b2-446f-9818-72c57f32e2cd tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:01.191060 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-84579191-20b2-446f-9818-72c57f32e2cd tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:01.192607 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-84579191-20b2-446f-9818-72c57f32e2cd tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:01.193768 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-84579191-20b2-446f-9818-72c57f32e2cd tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1745 microversion: 2.20 time: 0.164526 Aug 09 11:24:01.194324 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 412/863] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:24:01 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:24:02.002079 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-1e225ae9-8be1-4ef3-8a1c-c97741db0a23 req-274af1d7-699b-4f6b-bddd-c14958b3965a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "919c3009-894a-45e2-bc25-24df397fa3d0", "name": "network-vif-plugged", "status": "completed", "tag": "2572315b-325e-49c1-b65d-1b98ef984660"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:24:02.012545 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-1e225ae9-8be1-4ef3-8a1c-c97741db0a23 req-274af1d7-699b-4f6b-bddd-c14958b3965a service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:02.013774 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-1e225ae9-8be1-4ef3-8a1c-c97741db0a23 req-274af1d7-699b-4f6b-bddd-c14958b3965a service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:02.014219 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-1e225ae9-8be1-4ef3-8a1c-c97741db0a23 req-274af1d7-699b-4f6b-bddd-c14958b3965a service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:02.026475 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-1e225ae9-8be1-4ef3-8a1c-c97741db0a23 req-274af1d7-699b-4f6b-bddd-c14958b3965a service nova] Creating event network-vif-plugged:2572315b-325e-49c1-b65d-1b98ef984660 for instance 919c3009-894a-45e2-bc25-24df397fa3d0 on hv-cinder-85251 Aug 09 11:24:02.032192 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-1e225ae9-8be1-4ef3-8a1c-c97741db0a23 req-274af1d7-699b-4f6b-bddd-c14958b3965a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034631 Aug 09 11:24:02.032853 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 452/864] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:24:02.219814 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-5190ddfe-178a-44da-878c-d836d69c1ff9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:02.220380 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-5190ddfe-178a-44da-878c-d836d69c1ff9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:02.227187 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5190ddfe-178a-44da-878c-d836d69c1ff9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:02.227675 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5190ddfe-178a-44da-878c-d836d69c1ff9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:02.228108 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5190ddfe-178a-44da-878c-d836d69c1ff9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:02.228838 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5190ddfe-178a-44da-878c-d836d69c1ff9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:02.229286 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5190ddfe-178a-44da-878c-d836d69c1ff9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:02.229671 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5190ddfe-178a-44da-878c-d836d69c1ff9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:02.370514 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-5190ddfe-178a-44da-878c-d836d69c1ff9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:02.380034 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-5190ddfe-178a-44da-878c-d836d69c1ff9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:02.381563 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-5190ddfe-178a-44da-878c-d836d69c1ff9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:02.382714 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-5190ddfe-178a-44da-878c-d836d69c1ff9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1745 microversion: 2.20 time: 0.168000 Aug 09 11:24:02.383272 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 413/865] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:24:02 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1745 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:24:03.408814 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-50ff073f-9b91-469c-a7ea-dd83eb02eaa8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:03.410640 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-50ff073f-9b91-469c-a7ea-dd83eb02eaa8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:03.418266 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-50ff073f-9b91-469c-a7ea-dd83eb02eaa8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:03.418743 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-50ff073f-9b91-469c-a7ea-dd83eb02eaa8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:03.419179 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-50ff073f-9b91-469c-a7ea-dd83eb02eaa8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:03.419897 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-50ff073f-9b91-469c-a7ea-dd83eb02eaa8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:03.420442 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-50ff073f-9b91-469c-a7ea-dd83eb02eaa8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:03.421151 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-50ff073f-9b91-469c-a7ea-dd83eb02eaa8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:03.441028 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:24:03.591537 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-50ff073f-9b91-469c-a7ea-dd83eb02eaa8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:03.600234 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-50ff073f-9b91-469c-a7ea-dd83eb02eaa8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:03.601786 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-50ff073f-9b91-469c-a7ea-dd83eb02eaa8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:03.603149 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-50ff073f-9b91-469c-a7ea-dd83eb02eaa8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1740 microversion: 2.20 time: 0.200953 Aug 09 11:24:03.604192 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 453/866] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:24:03 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1740 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:24:04.627552 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-b2cbf32f-ab8c-4b80-a5f2-ce062b48451a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:04.628971 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-b2cbf32f-ab8c-4b80-a5f2-ce062b48451a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:04.636085 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b2cbf32f-ab8c-4b80-a5f2-ce062b48451a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:04.636602 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b2cbf32f-ab8c-4b80-a5f2-ce062b48451a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:04.637132 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b2cbf32f-ab8c-4b80-a5f2-ce062b48451a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:04.638075 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b2cbf32f-ab8c-4b80-a5f2-ce062b48451a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:04.638521 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b2cbf32f-ab8c-4b80-a5f2-ce062b48451a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:04.639183 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b2cbf32f-ab8c-4b80-a5f2-ce062b48451a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:04.787750 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-b2cbf32f-ab8c-4b80-a5f2-ce062b48451a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:04.799200 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-b2cbf32f-ab8c-4b80-a5f2-ce062b48451a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:04.800718 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-b2cbf32f-ab8c-4b80-a5f2-ce062b48451a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:04.802179 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-b2cbf32f-ab8c-4b80-a5f2-ce062b48451a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1740 microversion: 2.20 time: 0.179087 Aug 09 11:24:04.802724 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 414/867] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:24:04 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1740 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:24:05.826012 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-c119d5c9-ab00-4541-a84d-c9f35620dbdf tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:05.827680 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-c119d5c9-ab00-4541-a84d-c9f35620dbdf tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:05.833663 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c119d5c9-ab00-4541-a84d-c9f35620dbdf tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:05.834142 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c119d5c9-ab00-4541-a84d-c9f35620dbdf tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:05.834575 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c119d5c9-ab00-4541-a84d-c9f35620dbdf tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:05.835401 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c119d5c9-ab00-4541-a84d-c9f35620dbdf tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:05.835854 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c119d5c9-ab00-4541-a84d-c9f35620dbdf tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:05.836286 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c119d5c9-ab00-4541-a84d-c9f35620dbdf tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:05.986595 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-c119d5c9-ab00-4541-a84d-c9f35620dbdf tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:05.994846 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-c119d5c9-ab00-4541-a84d-c9f35620dbdf tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:05.996370 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-c119d5c9-ab00-4541-a84d-c9f35620dbdf tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:05.997526 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-c119d5c9-ab00-4541-a84d-c9f35620dbdf tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1740 microversion: 2.20 time: 0.175656 Aug 09 11:24:05.998534 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 454/868] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:24:05 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:24:07.021011 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-2c80a26d-5533-46d0-8473-d3406823606f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:07.022786 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-2c80a26d-5533-46d0-8473-d3406823606f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:07.034078 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2c80a26d-5533-46d0-8473-d3406823606f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:07.035030 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2c80a26d-5533-46d0-8473-d3406823606f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:07.035714 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2c80a26d-5533-46d0-8473-d3406823606f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:07.036444 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2c80a26d-5533-46d0-8473-d3406823606f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:07.037989 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2c80a26d-5533-46d0-8473-d3406823606f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:07.038423 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2c80a26d-5533-46d0-8473-d3406823606f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:07.208343 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-2c80a26d-5533-46d0-8473-d3406823606f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:07.225431 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-2c80a26d-5533-46d0-8473-d3406823606f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:07.227509 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-2c80a26d-5533-46d0-8473-d3406823606f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:07.229044 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-2c80a26d-5533-46d0-8473-d3406823606f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1740 microversion: 2.20 time: 0.212049 Aug 09 11:24:07.229626 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 415/869] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:24:07 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1740 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:24:07.894400 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-3d143937-628a-4ea2-8c45-c8f7c6bc93b2 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:07.900389 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-3d143937-628a-4ea2-8c45-c8f7c6bc93b2 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: 6c6b7435-b965-416a-ae82-7eb037cc7152] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:07.907350 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3d143937-628a-4ea2-8c45-c8f7c6bc93b2 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:07.907833 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3d143937-628a-4ea2-8c45-c8f7c6bc93b2 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:07.908286 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3d143937-628a-4ea2-8c45-c8f7c6bc93b2 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:07.909009 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3d143937-628a-4ea2-8c45-c8f7c6bc93b2 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:07.909625 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3d143937-628a-4ea2-8c45-c8f7c6bc93b2 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:07.910205 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3d143937-628a-4ea2-8c45-c8f7c6bc93b2 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:07.946137 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-3d143937-628a-4ea2-8c45-c8f7c6bc93b2 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055599 Aug 09 11:24:07.946739 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 455/870] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 9 11:24:07 2022] GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:24:07.957978 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-6129982d-fa72-4089-a068-5d51a04256ee tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:07.958484 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-6129982d-fa72-4089-a068-5d51a04256ee tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: 6c6b7435-b965-416a-ae82-7eb037cc7152] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:07.965474 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6129982d-fa72-4089-a068-5d51a04256ee tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:07.966096 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6129982d-fa72-4089-a068-5d51a04256ee tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:07.966753 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6129982d-fa72-4089-a068-5d51a04256ee tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:07.968443 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6129982d-fa72-4089-a068-5d51a04256ee tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:07.968922 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6129982d-fa72-4089-a068-5d51a04256ee tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:07.969358 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6129982d-fa72-4089-a068-5d51a04256ee tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:08.002739 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-6129982d-fa72-4089-a068-5d51a04256ee tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152/os-volume_attachments/09e8db26-d6cc-4931-9280-1e2fb5ae0ec8" status: 200 len: 194 microversion: 2.1 time: 0.048841 Aug 09 11:24:08.003360 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 416/871] 10.222.0.27 () {58 vars in 1413 bytes} [Tue Aug 9 11:24:07 2022] GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152/os-volume_attachments/09e8db26-d6cc-4931-9280-1e2fb5ae0ec8 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:24:08.263366 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-85f7d8f5-8e2f-4092-82a6-cb2a2782c582 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:08.265166 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-85f7d8f5-8e2f-4092-82a6-cb2a2782c582 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:08.282514 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-85f7d8f5-8e2f-4092-82a6-cb2a2782c582 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:08.283015 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-85f7d8f5-8e2f-4092-82a6-cb2a2782c582 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:08.283449 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-85f7d8f5-8e2f-4092-82a6-cb2a2782c582 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:08.284365 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-85f7d8f5-8e2f-4092-82a6-cb2a2782c582 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:08.284821 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-85f7d8f5-8e2f-4092-82a6-cb2a2782c582 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:08.287694 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-85f7d8f5-8e2f-4092-82a6-cb2a2782c582 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:08.464026 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-85f7d8f5-8e2f-4092-82a6-cb2a2782c582 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:08.479277 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-85f7d8f5-8e2f-4092-82a6-cb2a2782c582 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:08.481949 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-85f7d8f5-8e2f-4092-82a6-cb2a2782c582 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:08.483560 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-85f7d8f5-8e2f-4092-82a6-cb2a2782c582 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1740 microversion: 2.20 time: 0.233172 Aug 09 11:24:08.484113 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 456/872] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:24:08 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1740 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:24:09.400789 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-ba311564-9782-4dda-9155-68a938c9c5ec tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0dcb35fb-9fff-427d-8d53-0de5fd55a03b"}} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:24:09.403225 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-ba311564-9782-4dda-9155-68a938c9c5ec tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: 6c6b7435-b965-416a-ae82-7eb037cc7152] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:09.409770 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_api:SELECT=47 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:24:09.411724 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ba311564-9782-4dda-9155-68a938c9c5ec tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:09.412235 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ba311564-9782-4dda-9155-68a938c9c5ec tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:09.412697 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ba311564-9782-4dda-9155-68a938c9c5ec tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:09.413407 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ba311564-9782-4dda-9155-68a938c9c5ec tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:09.413854 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ba311564-9782-4dda-9155-68a938c9c5ec tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:09.414270 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ba311564-9782-4dda-9155-68a938c9c5ec tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:09.507917 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-9b5b6b83-0550-4e56-a18c-7919f297b2f7 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:09.509082 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-9b5b6b83-0550-4e56-a18c-7919f297b2f7 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:09.517002 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9b5b6b83-0550-4e56-a18c-7919f297b2f7 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:09.517212 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9b5b6b83-0550-4e56-a18c-7919f297b2f7 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:09.517738 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9b5b6b83-0550-4e56-a18c-7919f297b2f7 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:09.528457 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9b5b6b83-0550-4e56-a18c-7919f297b2f7 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:09.529195 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9b5b6b83-0550-4e56-a18c-7919f297b2f7 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:09.529867 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-9b5b6b83-0550-4e56-a18c-7919f297b2f7 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:09.744422 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-9b5b6b83-0550-4e56-a18c-7919f297b2f7 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:09.753877 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-9b5b6b83-0550-4e56-a18c-7919f297b2f7 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:09.755837 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-9b5b6b83-0550-4e56-a18c-7919f297b2f7 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:09.757270 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-ba311564-9782-4dda-9155-68a938c9c5ec tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "POST /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.362293 Aug 09 11:24:09.757551 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-9b5b6b83-0550-4e56-a18c-7919f297b2f7 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1740 microversion: 2.20 time: 0.253846 Aug 09 11:24:09.758351 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 457/873] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:24:09 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1740 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 11:24:09.760687 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 417/874] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Aug 9 11:24:09 2022] POST /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152/os-volume_attachments => generated 194 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:24:10.784446 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-c380b443-2c9d-4959-b30c-cb1bce55c7c8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:10.785124 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-c380b443-2c9d-4959-b30c-cb1bce55c7c8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:10.793026 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c380b443-2c9d-4959-b30c-cb1bce55c7c8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:10.793519 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c380b443-2c9d-4959-b30c-cb1bce55c7c8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:10.793947 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c380b443-2c9d-4959-b30c-cb1bce55c7c8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:10.794675 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c380b443-2c9d-4959-b30c-cb1bce55c7c8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:10.795162 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c380b443-2c9d-4959-b30c-cb1bce55c7c8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:10.795645 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c380b443-2c9d-4959-b30c-cb1bce55c7c8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:10.976713 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-c380b443-2c9d-4959-b30c-cb1bce55c7c8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:10.985150 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-c380b443-2c9d-4959-b30c-cb1bce55c7c8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:10.986658 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-c380b443-2c9d-4959-b30c-cb1bce55c7c8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:10.987888 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-c380b443-2c9d-4959-b30c-cb1bce55c7c8 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1740 microversion: 2.20 time: 0.208155 Aug 09 11:24:10.988523 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 458/875] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:24:10 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1740 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:24:12.012192 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-e8f7158b-0413-4110-8882-27d097d9ed47 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:12.012929 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-e8f7158b-0413-4110-8882-27d097d9ed47 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:12.019824 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e8f7158b-0413-4110-8882-27d097d9ed47 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:12.020297 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e8f7158b-0413-4110-8882-27d097d9ed47 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:12.020793 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e8f7158b-0413-4110-8882-27d097d9ed47 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:12.021479 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e8f7158b-0413-4110-8882-27d097d9ed47 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:12.022273 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e8f7158b-0413-4110-8882-27d097d9ed47 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:12.022690 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e8f7158b-0413-4110-8882-27d097d9ed47 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:12.161876 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-e8f7158b-0413-4110-8882-27d097d9ed47 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:12.170434 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-e8f7158b-0413-4110-8882-27d097d9ed47 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:12.171894 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-e8f7158b-0413-4110-8882-27d097d9ed47 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:12.173058 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-e8f7158b-0413-4110-8882-27d097d9ed47 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1740 microversion: 2.20 time: 0.165778 Aug 09 11:24:12.173623 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 418/876] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:24:12 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1740 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:24:13.199576 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-48bebf62-23a3-4874-927f-f648dd5e04da tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:13.200369 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-48bebf62-23a3-4874-927f-f648dd5e04da tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:13.208211 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-48bebf62-23a3-4874-927f-f648dd5e04da tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:13.208731 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-48bebf62-23a3-4874-927f-f648dd5e04da tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:13.209147 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-48bebf62-23a3-4874-927f-f648dd5e04da tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:13.209827 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-48bebf62-23a3-4874-927f-f648dd5e04da tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:13.210272 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-48bebf62-23a3-4874-927f-f648dd5e04da tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:13.210678 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-48bebf62-23a3-4874-927f-f648dd5e04da tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:13.345680 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-48bebf62-23a3-4874-927f-f648dd5e04da tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:13.354002 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-48bebf62-23a3-4874-927f-f648dd5e04da tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:13.355489 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-48bebf62-23a3-4874-927f-f648dd5e04da tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:13.356666 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-48bebf62-23a3-4874-927f-f648dd5e04da tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1722 microversion: 2.20 time: 0.163581 Aug 09 11:24:13.357223 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 459/877] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:24:13 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:24:14.383304 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-bbe1c287-367b-415f-ba7a-92ebc9066b03 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:14.384337 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-bbe1c287-367b-415f-ba7a-92ebc9066b03 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:14.395964 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-bbe1c287-367b-415f-ba7a-92ebc9066b03 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:14.397282 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-bbe1c287-367b-415f-ba7a-92ebc9066b03 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:14.397998 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-bbe1c287-367b-415f-ba7a-92ebc9066b03 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:14.399145 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-bbe1c287-367b-415f-ba7a-92ebc9066b03 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:14.399920 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-bbe1c287-367b-415f-ba7a-92ebc9066b03 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:14.400665 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-bbe1c287-367b-415f-ba7a-92ebc9066b03 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:14.537885 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-bbe1c287-367b-415f-ba7a-92ebc9066b03 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:14.548988 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-bbe1c287-367b-415f-ba7a-92ebc9066b03 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:14.550470 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-bbe1c287-367b-415f-ba7a-92ebc9066b03 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:14.551617 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-bbe1c287-367b-415f-ba7a-92ebc9066b03 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1722 microversion: 2.20 time: 0.174804 Aug 09 11:24:14.552177 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 419/878] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:24:14 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:24:15.581572 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-2132425b-6bdb-4977-9b1e-a99b9f0eaae3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:15.582408 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-2132425b-6bdb-4977-9b1e-a99b9f0eaae3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:15.591378 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2132425b-6bdb-4977-9b1e-a99b9f0eaae3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:15.592026 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2132425b-6bdb-4977-9b1e-a99b9f0eaae3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:15.592646 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2132425b-6bdb-4977-9b1e-a99b9f0eaae3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:15.593576 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2132425b-6bdb-4977-9b1e-a99b9f0eaae3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:15.594168 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2132425b-6bdb-4977-9b1e-a99b9f0eaae3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:15.594733 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2132425b-6bdb-4977-9b1e-a99b9f0eaae3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:15.734661 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-2132425b-6bdb-4977-9b1e-a99b9f0eaae3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:15.743022 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-2132425b-6bdb-4977-9b1e-a99b9f0eaae3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:15.744556 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-2132425b-6bdb-4977-9b1e-a99b9f0eaae3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:15.745734 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-2132425b-6bdb-4977-9b1e-a99b9f0eaae3 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1665 microversion: 2.20 time: 0.170235 Aug 09 11:24:15.746297 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 460/879] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:24:15 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1665 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:24:15.768450 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-2913bd8f-b2d4-4a61-913e-552b0b6268b2 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52c57eb0-238f-4f7f-868d-f06cdc160b93"}} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:24:15.770874 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-2913bd8f-b2d4-4a61-913e-552b0b6268b2 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:15.778198 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2913bd8f-b2d4-4a61-913e-552b0b6268b2 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:15.778721 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2913bd8f-b2d4-4a61-913e-552b0b6268b2 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:15.779275 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2913bd8f-b2d4-4a61-913e-552b0b6268b2 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:15.779971 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2913bd8f-b2d4-4a61-913e-552b0b6268b2 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:15.780669 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2913bd8f-b2d4-4a61-913e-552b0b6268b2 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:15.781182 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2913bd8f-b2d4-4a61-913e-552b0b6268b2 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:15.783951 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:24:16.083956 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-a6ca5910-8ef3-4f8c-b9e0-5970055bbdf5 req-361381ac-5d5e-488b-b492-73776441422f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "919c3009-894a-45e2-bc25-24df397fa3d0", "name": "network-vif-unplugged", "status": "completed", "tag": "2572315b-325e-49c1-b65d-1b98ef984660"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:24:16.095989 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-a6ca5910-8ef3-4f8c-b9e0-5970055bbdf5 req-361381ac-5d5e-488b-b492-73776441422f service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:16.096636 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-a6ca5910-8ef3-4f8c-b9e0-5970055bbdf5 req-361381ac-5d5e-488b-b492-73776441422f service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:16.097355 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-a6ca5910-8ef3-4f8c-b9e0-5970055bbdf5 req-361381ac-5d5e-488b-b492-73776441422f service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:16.103217 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-2913bd8f-b2d4-4a61-913e-552b0b6268b2 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "POST /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.338452 Aug 09 11:24:16.103963 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 420/880] 10.222.0.27 () {62 vars in 1364 bytes} [Tue Aug 9 11:24:15 2022] POST /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0/os-volume_attachments => generated 188 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 11:24:16.117409 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.compute.server_external_events [req-a6ca5910-8ef3-4f8c-b9e0-5970055bbdf5 req-361381ac-5d5e-488b-b492-73776441422f service nova] Unable to find a host for instance 919c3009-894a-45e2-bc25-24df397fa3d0. Dropping event network-vif-unplugged {{(pid=117685) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 09 11:24:16.118366 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-a6ca5910-8ef3-4f8c-b9e0-5970055bbdf5 req-361381ac-5d5e-488b-b492-73776441422f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.039431 Aug 09 11:24:16.119366 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 461/881] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 41 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 09 11:24:16.230290 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-4150e75c-20d4-483b-a730-5e0caa627e42 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:16.230779 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-4150e75c-20d4-483b-a730-5e0caa627e42 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:16.237929 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4150e75c-20d4-483b-a730-5e0caa627e42 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:16.238725 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4150e75c-20d4-483b-a730-5e0caa627e42 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:16.239189 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4150e75c-20d4-483b-a730-5e0caa627e42 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:16.239866 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4150e75c-20d4-483b-a730-5e0caa627e42 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:16.240483 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4150e75c-20d4-483b-a730-5e0caa627e42 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:16.240900 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4150e75c-20d4-483b-a730-5e0caa627e42 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:16.497491 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-4150e75c-20d4-483b-a730-5e0caa627e42 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "DELETE /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0/os-volume_attachments/52c57eb0-238f-4f7f-868d-f06cdc160b93" status: 202 len: 0 microversion: 2.20 time: 0.271259 Aug 09 11:24:16.498172 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 421/882] 10.222.0.27 () {60 vars in 1457 bytes} [Tue Aug 9 11:24:16 2022] DELETE /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0/os-volume_attachments/52c57eb0-238f-4f7f-868d-f06cdc160b93 => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 09 11:24:16.563799 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-7bd97bc9-e2bd-4c1c-839e-170569096342 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:24:16.564435 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-7bd97bc9-e2bd-4c1c-839e-170569096342 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:16.571112 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7bd97bc9-e2bd-4c1c-839e-170569096342 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:16.571591 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7bd97bc9-e2bd-4c1c-839e-170569096342 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:16.572013 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7bd97bc9-e2bd-4c1c-839e-170569096342 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:16.572807 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7bd97bc9-e2bd-4c1c-839e-170569096342 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:16.573248 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7bd97bc9-e2bd-4c1c-839e-170569096342 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:16.573665 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7bd97bc9-e2bd-4c1c-839e-170569096342 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:16.604894 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-7bd97bc9-e2bd-4c1c-839e-170569096342 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117685) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 09 11:24:16.677308 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-7bd97bc9-e2bd-4c1c-839e-170569096342 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "POST /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0/action" status: 202 len: 0 microversion: 2.20 time: 0.119521 Aug 09 11:24:16.677850 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 462/883] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Aug 9 11:24:16 2022] POST /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 11:24:16.686213 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-d7458ef5-121c-4f65-a8b6-c934f96d67c6 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:16.686821 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-d7458ef5-121c-4f65-a8b6-c934f96d67c6 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:16.692938 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d7458ef5-121c-4f65-a8b6-c934f96d67c6 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:16.693414 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d7458ef5-121c-4f65-a8b6-c934f96d67c6 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:16.693841 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d7458ef5-121c-4f65-a8b6-c934f96d67c6 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:16.694528 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d7458ef5-121c-4f65-a8b6-c934f96d67c6 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:16.695014 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d7458ef5-121c-4f65-a8b6-c934f96d67c6 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:16.695398 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d7458ef5-121c-4f65-a8b6-c934f96d67c6 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:16.840352 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-d7458ef5-121c-4f65-a8b6-c934f96d67c6 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:16.849008 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-d7458ef5-121c-4f65-a8b6-c934f96d67c6 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:16.850522 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-d7458ef5-121c-4f65-a8b6-c934f96d67c6 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:16.851663 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-d7458ef5-121c-4f65-a8b6-c934f96d67c6 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1673 microversion: 2.20 time: 0.169402 Aug 09 11:24:16.852302 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 422/884] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:24:16 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1673 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:24:17.398693 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-254fdd43-c5da-4814-b568-4894e7a9d965 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:17.400985 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-254fdd43-c5da-4814-b568-4894e7a9d965 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: 6c6b7435-b965-416a-ae82-7eb037cc7152] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:17.407285 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-254fdd43-c5da-4814-b568-4894e7a9d965 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:17.407767 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-254fdd43-c5da-4814-b568-4894e7a9d965 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:17.408195 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-254fdd43-c5da-4814-b568-4894e7a9d965 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:17.408906 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-254fdd43-c5da-4814-b568-4894e7a9d965 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:17.409343 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-254fdd43-c5da-4814-b568-4894e7a9d965 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:17.409758 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-254fdd43-c5da-4814-b568-4894e7a9d965 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:17.440476 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-254fdd43-c5da-4814-b568-4894e7a9d965 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046074 Aug 09 11:24:17.441265 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 463/885] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 9 11:24:17 2022] GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:24:17.594053 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-2ff459fd-25f1-4463-9cb4-2cf9fe7c1cc8 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:17.595028 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-2ff459fd-25f1-4463-9cb4-2cf9fe7c1cc8 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: 6c6b7435-b965-416a-ae82-7eb037cc7152] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:17.605389 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2ff459fd-25f1-4463-9cb4-2cf9fe7c1cc8 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:17.605880 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2ff459fd-25f1-4463-9cb4-2cf9fe7c1cc8 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:17.606316 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2ff459fd-25f1-4463-9cb4-2cf9fe7c1cc8 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:17.607025 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2ff459fd-25f1-4463-9cb4-2cf9fe7c1cc8 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:17.607942 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2ff459fd-25f1-4463-9cb4-2cf9fe7c1cc8 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:17.608598 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2ff459fd-25f1-4463-9cb4-2cf9fe7c1cc8 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:17.638925 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-2ff459fd-25f1-4463-9cb4-2cf9fe7c1cc8 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152/os-volume_attachments/09e8db26-d6cc-4931-9280-1e2fb5ae0ec8" status: 200 len: 194 microversion: 2.1 time: 0.049655 Aug 09 11:24:17.639529 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 423/886] 10.222.0.27 () {58 vars in 1413 bytes} [Tue Aug 9 11:24:17 2022] GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152/os-volume_attachments/09e8db26-d6cc-4931-9280-1e2fb5ae0ec8 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:24:17.653812 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-cf854248-5560-4bdd-ae69-33e51ffba987 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:17.654961 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-cf854248-5560-4bdd-ae69-33e51ffba987 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: 6c6b7435-b965-416a-ae82-7eb037cc7152] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:17.661566 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-cf854248-5560-4bdd-ae69-33e51ffba987 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:17.662051 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-cf854248-5560-4bdd-ae69-33e51ffba987 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:17.662480 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-cf854248-5560-4bdd-ae69-33e51ffba987 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:17.663178 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-cf854248-5560-4bdd-ae69-33e51ffba987 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:17.663626 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-cf854248-5560-4bdd-ae69-33e51ffba987 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:17.664047 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-cf854248-5560-4bdd-ae69-33e51ffba987 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:17.753664 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.objects.instance [None req-cf854248-5560-4bdd-ae69-33e51ffba987 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lazy-loading 'services' on Instance uuid 6c6b7435-b965-416a-ae82-7eb037cc7152 {{(pid=117685) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:24:17.833374 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-cf854248-5560-4bdd-ae69-33e51ffba987 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152/os-volume_attachments/09e8db26-d6cc-4931-9280-1e2fb5ae0ec8" status: 202 len: 0 microversion: 2.1 time: 0.183943 Aug 09 11:24:17.833969 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 464/887] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Aug 9 11:24:17 2022] DELETE /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152/os-volume_attachments/09e8db26-d6cc-4931-9280-1e2fb5ae0ec8 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:24:17.874888 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-cac612ed-cbf8-4ba7-b754-bcde4d7b5965 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:17.875773 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-cac612ed-cbf8-4ba7-b754-bcde4d7b5965 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:17.893207 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cac612ed-cbf8-4ba7-b754-bcde4d7b5965 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:17.893207 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cac612ed-cbf8-4ba7-b754-bcde4d7b5965 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:17.893207 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cac612ed-cbf8-4ba7-b754-bcde4d7b5965 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:17.893207 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cac612ed-cbf8-4ba7-b754-bcde4d7b5965 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:17.893590 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cac612ed-cbf8-4ba7-b754-bcde4d7b5965 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:17.893590 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cac612ed-cbf8-4ba7-b754-bcde4d7b5965 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:18.028014 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-cac612ed-cbf8-4ba7-b754-bcde4d7b5965 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:18.036666 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-cac612ed-cbf8-4ba7-b754-bcde4d7b5965 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:18.038153 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-cac612ed-cbf8-4ba7-b754-bcde4d7b5965 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:18.039296 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-cac612ed-cbf8-4ba7-b754-bcde4d7b5965 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1731 microversion: 2.20 time: 0.168429 Aug 09 11:24:18.039821 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 424/888] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:24:17 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:24:19.065163 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-1f884a89-fdc4-4d21-9af3-ccda8bf51629 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:19.065991 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-1f884a89-fdc4-4d21-9af3-ccda8bf51629 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:19.072721 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1f884a89-fdc4-4d21-9af3-ccda8bf51629 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:19.073384 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1f884a89-fdc4-4d21-9af3-ccda8bf51629 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:19.073930 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1f884a89-fdc4-4d21-9af3-ccda8bf51629 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:19.074786 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1f884a89-fdc4-4d21-9af3-ccda8bf51629 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:19.075231 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1f884a89-fdc4-4d21-9af3-ccda8bf51629 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:19.075647 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1f884a89-fdc4-4d21-9af3-ccda8bf51629 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:19.465219 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-1f884a89-fdc4-4d21-9af3-ccda8bf51629 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:19.473744 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-1f884a89-fdc4-4d21-9af3-ccda8bf51629 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:19.475237 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-1f884a89-fdc4-4d21-9af3-ccda8bf51629 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:19.476445 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-1f884a89-fdc4-4d21-9af3-ccda8bf51629 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1731 microversion: 2.20 time: 0.416748 Aug 09 11:24:19.476957 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 465/889] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:24:19 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1731 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:24:20.026650 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-c76db968-c072-4d3a-b44e-8730e8163f76 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:20.027765 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-c76db968-c072-4d3a-b44e-8730e8163f76 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: 6c6b7435-b965-416a-ae82-7eb037cc7152] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:20.036737 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c76db968-c072-4d3a-b44e-8730e8163f76 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:20.037226 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c76db968-c072-4d3a-b44e-8730e8163f76 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:20.037653 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c76db968-c072-4d3a-b44e-8730e8163f76 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:20.038358 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c76db968-c072-4d3a-b44e-8730e8163f76 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:20.038801 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c76db968-c072-4d3a-b44e-8730e8163f76 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:20.039408 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c76db968-c072-4d3a-b44e-8730e8163f76 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:20.069994 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-c76db968-c072-4d3a-b44e-8730e8163f76 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152/os-volume_attachments/0dcb35fb-9fff-427d-8d53-0de5fd55a03b" status: 200 len: 194 microversion: 2.1 time: 0.047850 Aug 09 11:24:20.070587 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 425/890] 10.222.0.27 () {58 vars in 1413 bytes} [Tue Aug 9 11:24:20 2022] GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152/os-volume_attachments/0dcb35fb-9fff-427d-8d53-0de5fd55a03b => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:24:20.082977 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-79bbdc49-09d7-43b3-909a-f47ff36fbef5 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:20.084404 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-79bbdc49-09d7-43b3-909a-f47ff36fbef5 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: 6c6b7435-b965-416a-ae82-7eb037cc7152] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:20.091480 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-79bbdc49-09d7-43b3-909a-f47ff36fbef5 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:20.091974 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-79bbdc49-09d7-43b3-909a-f47ff36fbef5 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:20.092456 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-79bbdc49-09d7-43b3-909a-f47ff36fbef5 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:20.093167 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-79bbdc49-09d7-43b3-909a-f47ff36fbef5 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:20.093652 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-79bbdc49-09d7-43b3-909a-f47ff36fbef5 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:20.094081 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-79bbdc49-09d7-43b3-909a-f47ff36fbef5 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:20.184685 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.objects.instance [None req-79bbdc49-09d7-43b3-909a-f47ff36fbef5 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lazy-loading 'services' on Instance uuid 6c6b7435-b965-416a-ae82-7eb037cc7152 {{(pid=117685) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:24:20.266720 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-79bbdc49-09d7-43b3-909a-f47ff36fbef5 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152/os-volume_attachments/0dcb35fb-9fff-427d-8d53-0de5fd55a03b" status: 202 len: 0 microversion: 2.1 time: 0.188559 Aug 09 11:24:20.267323 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 466/891] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Aug 9 11:24:20 2022] DELETE /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152/os-volume_attachments/0dcb35fb-9fff-427d-8d53-0de5fd55a03b => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:24:20.501223 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-8da924e5-240e-4eec-9316-99118f70578d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:20.501722 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-8da924e5-240e-4eec-9316-99118f70578d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:20.508395 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8da924e5-240e-4eec-9316-99118f70578d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:20.508875 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8da924e5-240e-4eec-9316-99118f70578d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:20.509302 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8da924e5-240e-4eec-9316-99118f70578d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:20.509991 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8da924e5-240e-4eec-9316-99118f70578d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:20.510434 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8da924e5-240e-4eec-9316-99118f70578d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:20.516507 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8da924e5-240e-4eec-9316-99118f70578d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:20.651204 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-8da924e5-240e-4eec-9316-99118f70578d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:20.660135 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-8da924e5-240e-4eec-9316-99118f70578d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:20.661670 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-8da924e5-240e-4eec-9316-99118f70578d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:20.662844 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-8da924e5-240e-4eec-9316-99118f70578d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1731 microversion: 2.20 time: 0.167141 Aug 09 11:24:20.663405 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 426/892] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:24:20 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:24:21.080807 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-c8648614-943d-4998-8752-f8c3da490d7b tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:21.081379 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-c8648614-943d-4998-8752-f8c3da490d7b tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 92aed47a-39ca-4174-9ae4-b99c2fb029e1] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:21.088710 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c8648614-943d-4998-8752-f8c3da490d7b tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:21.089302 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c8648614-943d-4998-8752-f8c3da490d7b tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:21.089609 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c8648614-943d-4998-8752-f8c3da490d7b tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:21.090309 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c8648614-943d-4998-8752-f8c3da490d7b tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:21.090756 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c8648614-943d-4998-8752-f8c3da490d7b tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:21.091146 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c8648614-943d-4998-8752-f8c3da490d7b tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:21.116417 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-c8648614-943d-4998-8752-f8c3da490d7b tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/92aed47a-39ca-4174-9ae4-b99c2fb029e1/ips" status: 200 len: 151 microversion: 2.1 time: 0.040680 Aug 09 11:24:21.117007 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 467/893] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Aug 9 11:24:21 2022] GET /compute/v2.1/servers/92aed47a-39ca-4174-9ae4-b99c2fb029e1/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:24:21.686467 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-de66683b-c4e5-4678-a065-704e01f62c52 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:21.687208 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-de66683b-c4e5-4678-a065-704e01f62c52 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:21.694604 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-de66683b-c4e5-4678-a065-704e01f62c52 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:21.695062 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-de66683b-c4e5-4678-a065-704e01f62c52 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:21.695740 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-de66683b-c4e5-4678-a065-704e01f62c52 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:21.696481 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-de66683b-c4e5-4678-a065-704e01f62c52 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:21.697066 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-de66683b-c4e5-4678-a065-704e01f62c52 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:21.697522 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-de66683b-c4e5-4678-a065-704e01f62c52 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:21.842132 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-de66683b-c4e5-4678-a065-704e01f62c52 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:21.851065 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-de66683b-c4e5-4678-a065-704e01f62c52 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:21.853985 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-de66683b-c4e5-4678-a065-704e01f62c52 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:21.855754 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-de66683b-c4e5-4678-a065-704e01f62c52 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1731 microversion: 2.20 time: 0.173780 Aug 09 11:24:21.856584 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 427/894] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:24:21 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:24:22.499162 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-61a82817-0108-4bf8-9cd0-6d6fea44c241 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6621810c-32bd-42a2-98db-989f0be44e5f"}} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:24:22.501703 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-61a82817-0108-4bf8-9cd0-6d6fea44c241 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 92aed47a-39ca-4174-9ae4-b99c2fb029e1] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:22.510142 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-61a82817-0108-4bf8-9cd0-6d6fea44c241 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:22.510910 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-61a82817-0108-4bf8-9cd0-6d6fea44c241 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:22.511332 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-61a82817-0108-4bf8-9cd0-6d6fea44c241 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:22.512032 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-61a82817-0108-4bf8-9cd0-6d6fea44c241 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:22.512522 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-61a82817-0108-4bf8-9cd0-6d6fea44c241 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:22.512941 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-61a82817-0108-4bf8-9cd0-6d6fea44c241 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:22.591762 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=3 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:24:22.880640 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-5c5ab9de-ee1f-40c1-9f8c-e642234b897a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:22.880640 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-5c5ab9de-ee1f-40c1-9f8c-e642234b897a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:22.887059 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5c5ab9de-ee1f-40c1-9f8c-e642234b897a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:22.887547 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5c5ab9de-ee1f-40c1-9f8c-e642234b897a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:22.887946 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5c5ab9de-ee1f-40c1-9f8c-e642234b897a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:22.888872 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5c5ab9de-ee1f-40c1-9f8c-e642234b897a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:22.889489 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5c5ab9de-ee1f-40c1-9f8c-e642234b897a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:22.889913 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5c5ab9de-ee1f-40c1-9f8c-e642234b897a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:23.054575 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-5c5ab9de-ee1f-40c1-9f8c-e642234b897a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:23.063380 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-5c5ab9de-ee1f-40c1-9f8c-e642234b897a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:23.064923 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-5c5ab9de-ee1f-40c1-9f8c-e642234b897a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:23.066105 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-5c5ab9de-ee1f-40c1-9f8c-e642234b897a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1731 microversion: 2.20 time: 0.190808 Aug 09 11:24:23.066673 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 428/895] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:24:22 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1731 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:24:24.088671 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-a4835582-c1ae-41cb-91a5-47e1256e6bc6 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:24.089364 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-a4835582-c1ae-41cb-91a5-47e1256e6bc6 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:24.096115 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a4835582-c1ae-41cb-91a5-47e1256e6bc6 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:24.096641 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a4835582-c1ae-41cb-91a5-47e1256e6bc6 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:24.097079 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a4835582-c1ae-41cb-91a5-47e1256e6bc6 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:24.097785 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a4835582-c1ae-41cb-91a5-47e1256e6bc6 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:24.098255 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a4835582-c1ae-41cb-91a5-47e1256e6bc6 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:24.098674 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a4835582-c1ae-41cb-91a5-47e1256e6bc6 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:24.246837 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-a4835582-c1ae-41cb-91a5-47e1256e6bc6 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:24.259805 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-a4835582-c1ae-41cb-91a5-47e1256e6bc6 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:24.261328 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-a4835582-c1ae-41cb-91a5-47e1256e6bc6 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:24.262487 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-a4835582-c1ae-41cb-91a5-47e1256e6bc6 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1731 microversion: 2.20 time: 0.177878 Aug 09 11:24:24.263043 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 429/896] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:24:24 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:24:25.287242 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-ac9bd8f5-0e48-4ba1-8bda-56c87d56a23f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:25.288416 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-ac9bd8f5-0e48-4ba1-8bda-56c87d56a23f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:25.296881 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ac9bd8f5-0e48-4ba1-8bda-56c87d56a23f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:25.297913 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ac9bd8f5-0e48-4ba1-8bda-56c87d56a23f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:25.298424 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ac9bd8f5-0e48-4ba1-8bda-56c87d56a23f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:25.299220 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ac9bd8f5-0e48-4ba1-8bda-56c87d56a23f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:25.299751 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ac9bd8f5-0e48-4ba1-8bda-56c87d56a23f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:25.300241 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ac9bd8f5-0e48-4ba1-8bda-56c87d56a23f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:25.445843 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-ac9bd8f5-0e48-4ba1-8bda-56c87d56a23f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:25.455066 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-ac9bd8f5-0e48-4ba1-8bda-56c87d56a23f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:25.456606 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-ac9bd8f5-0e48-4ba1-8bda-56c87d56a23f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:25.458028 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-ac9bd8f5-0e48-4ba1-8bda-56c87d56a23f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1731 microversion: 2.20 time: 0.175203 Aug 09 11:24:25.458626 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 430/897] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:24:25 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:24:25.821697 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-767834d7-a692-4a23-96c8-8db248fb0300 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:25.822593 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-767834d7-a692-4a23-96c8-8db248fb0300 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:25.829156 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-767834d7-a692-4a23-96c8-8db248fb0300 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:25.829689 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-767834d7-a692-4a23-96c8-8db248fb0300 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:25.830486 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-767834d7-a692-4a23-96c8-8db248fb0300 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:25.831206 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-767834d7-a692-4a23-96c8-8db248fb0300 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:25.831771 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-767834d7-a692-4a23-96c8-8db248fb0300 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:25.832544 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-767834d7-a692-4a23-96c8-8db248fb0300 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:25.853153 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:24:25.940211 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.objects.instance [None req-767834d7-a692-4a23-96c8-8db248fb0300 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lazy-loading 'services' on Instance uuid 8009a1a2-4c8e-4953-ba5c-faab2db05078 {{(pid=117684) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:24:26.024473 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-767834d7-a692-4a23-96c8-8db248fb0300 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078/os-volume_attachments/6118fb56-c184-44e6-b8e5-97a95cbac9d2" status: 202 len: 0 microversion: 2.1 time: 0.206528 Aug 09 11:24:26.028587 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 431/898] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Aug 9 11:24:25 2022] DELETE /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078/os-volume_attachments/6118fb56-c184-44e6-b8e5-97a95cbac9d2 => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 11:24:26.034229 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-5859d6f4-74e0-4d4f-9535-f55c5a88aef6 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:26.036763 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-5859d6f4-74e0-4d4f-9535-f55c5a88aef6 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:26.043371 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5859d6f4-74e0-4d4f-9535-f55c5a88aef6 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:26.043931 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5859d6f4-74e0-4d4f-9535-f55c5a88aef6 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:26.044482 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5859d6f4-74e0-4d4f-9535-f55c5a88aef6 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:26.045262 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5859d6f4-74e0-4d4f-9535-f55c5a88aef6 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:26.045779 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5859d6f4-74e0-4d4f-9535-f55c5a88aef6 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:26.046296 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5859d6f4-74e0-4d4f-9535-f55c5a88aef6 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:26.077939 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-5859d6f4-74e0-4d4f-9535-f55c5a88aef6 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047801 Aug 09 11:24:26.078960 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 432/899] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 9 11:24:26 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:24:26.481931 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-70943607-564e-467f-b4bf-c3a8c457174a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:26.482642 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-70943607-564e-467f-b4bf-c3a8c457174a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:26.490366 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-70943607-564e-467f-b4bf-c3a8c457174a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:26.491307 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-70943607-564e-467f-b4bf-c3a8c457174a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:26.491904 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-70943607-564e-467f-b4bf-c3a8c457174a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:26.492847 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-70943607-564e-467f-b4bf-c3a8c457174a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:26.493253 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-70943607-564e-467f-b4bf-c3a8c457174a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:26.493847 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-70943607-564e-467f-b4bf-c3a8c457174a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:26.647516 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-70943607-564e-467f-b4bf-c3a8c457174a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:26.656129 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-70943607-564e-467f-b4bf-c3a8c457174a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:26.657682 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-70943607-564e-467f-b4bf-c3a8c457174a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:26.658906 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-70943607-564e-467f-b4bf-c3a8c457174a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1731 microversion: 2.20 time: 0.181532 Aug 09 11:24:26.659470 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 433/900] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:24:26 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:24:27.092624 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-13c02187-ab45-424f-9fe5-b72def214bb2 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:27.095875 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-13c02187-ab45-424f-9fe5-b72def214bb2 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:27.103572 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-13c02187-ab45-424f-9fe5-b72def214bb2 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:27.104592 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-13c02187-ab45-424f-9fe5-b72def214bb2 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:27.104814 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-13c02187-ab45-424f-9fe5-b72def214bb2 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:27.105739 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-13c02187-ab45-424f-9fe5-b72def214bb2 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:27.106311 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-13c02187-ab45-424f-9fe5-b72def214bb2 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:27.106823 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-13c02187-ab45-424f-9fe5-b72def214bb2 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:27.141458 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-13c02187-ab45-424f-9fe5-b72def214bb2 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053547 Aug 09 11:24:27.142287 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 434/901] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 9 11:24:27 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:24:27.682437 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-068ce8f7-a0da-4997-91bd-59f0014ed1f9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:27.683174 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-068ce8f7-a0da-4997-91bd-59f0014ed1f9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:27.690666 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-068ce8f7-a0da-4997-91bd-59f0014ed1f9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:27.691172 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-068ce8f7-a0da-4997-91bd-59f0014ed1f9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:27.691602 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-068ce8f7-a0da-4997-91bd-59f0014ed1f9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:27.692319 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-068ce8f7-a0da-4997-91bd-59f0014ed1f9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:27.692763 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-068ce8f7-a0da-4997-91bd-59f0014ed1f9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:27.693183 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-068ce8f7-a0da-4997-91bd-59f0014ed1f9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:27.863220 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-068ce8f7-a0da-4997-91bd-59f0014ed1f9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:27.871966 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-068ce8f7-a0da-4997-91bd-59f0014ed1f9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:27.878443 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-068ce8f7-a0da-4997-91bd-59f0014ed1f9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:27.879861 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-068ce8f7-a0da-4997-91bd-59f0014ed1f9 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1731 microversion: 2.20 time: 0.201861 Aug 09 11:24:27.880579 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 435/902] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:24:27 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1731 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:24:28.154558 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-e7a42f84-9984-4d28-b7dd-2d330cca3a2f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:28.157372 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-e7a42f84-9984-4d28-b7dd-2d330cca3a2f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:28.164211 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e7a42f84-9984-4d28-b7dd-2d330cca3a2f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:28.164729 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e7a42f84-9984-4d28-b7dd-2d330cca3a2f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:28.165163 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e7a42f84-9984-4d28-b7dd-2d330cca3a2f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:28.165866 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e7a42f84-9984-4d28-b7dd-2d330cca3a2f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:28.166320 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e7a42f84-9984-4d28-b7dd-2d330cca3a2f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:28.166776 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e7a42f84-9984-4d28-b7dd-2d330cca3a2f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:28.199267 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-e7a42f84-9984-4d28-b7dd-2d330cca3a2f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048831 Aug 09 11:24:28.200099 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 436/903] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 9 11:24:28 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:24:28.903545 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-fbc1b0c2-1d97-45a1-96db-bd74ea337c8e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:28.904237 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-fbc1b0c2-1d97-45a1-96db-bd74ea337c8e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:28.911715 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-fbc1b0c2-1d97-45a1-96db-bd74ea337c8e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:28.912464 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-fbc1b0c2-1d97-45a1-96db-bd74ea337c8e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:28.918169 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-fbc1b0c2-1d97-45a1-96db-bd74ea337c8e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:28.919506 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-fbc1b0c2-1d97-45a1-96db-bd74ea337c8e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:28.919506 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-fbc1b0c2-1d97-45a1-96db-bd74ea337c8e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:28.920315 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-fbc1b0c2-1d97-45a1-96db-bd74ea337c8e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:29.072191 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-fbc1b0c2-1d97-45a1-96db-bd74ea337c8e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:29.080590 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-fbc1b0c2-1d97-45a1-96db-bd74ea337c8e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:29.082097 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-fbc1b0c2-1d97-45a1-96db-bd74ea337c8e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:29.083264 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-fbc1b0c2-1d97-45a1-96db-bd74ea337c8e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1731 microversion: 2.20 time: 0.183843 Aug 09 11:24:29.083830 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 437/904] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:24:28 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1731 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 11:24:29.211375 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-8c7a81c0-fd09-4ab5-b61d-ef0bf04e6b74 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:29.213571 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-8c7a81c0-fd09-4ab5-b61d-ef0bf04e6b74 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:29.220304 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8c7a81c0-fd09-4ab5-b61d-ef0bf04e6b74 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:29.220798 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8c7a81c0-fd09-4ab5-b61d-ef0bf04e6b74 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:29.221234 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8c7a81c0-fd09-4ab5-b61d-ef0bf04e6b74 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:29.221907 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8c7a81c0-fd09-4ab5-b61d-ef0bf04e6b74 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:29.222389 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8c7a81c0-fd09-4ab5-b61d-ef0bf04e6b74 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:29.222811 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8c7a81c0-fd09-4ab5-b61d-ef0bf04e6b74 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:29.255633 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-8c7a81c0-fd09-4ab5-b61d-ef0bf04e6b74 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048205 Aug 09 11:24:29.256218 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 438/905] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 9 11:24:29 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:24:29.925844 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-61a82817-0108-4bf8-9cd0-6d6fea44c241 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "POST /compute/v2.1/servers/92aed47a-39ca-4174-9ae4-b99c2fb029e1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.430228 Aug 09 11:24:29.927188 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 468/906] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Aug 9 11:24:22 2022] POST /compute/v2.1/servers/92aed47a-39ca-4174-9ae4-b99c2fb029e1/os-volume_attachments => generated 194 bytes in 7433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:24:30.112884 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-de4f78e0-c813-4d2f-bb82-dc4b11debba0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:30.113990 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-de4f78e0-c813-4d2f-bb82-dc4b11debba0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:30.125017 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-de4f78e0-c813-4d2f-bb82-dc4b11debba0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:30.125512 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-de4f78e0-c813-4d2f-bb82-dc4b11debba0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:30.125944 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-de4f78e0-c813-4d2f-bb82-dc4b11debba0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:30.126629 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-de4f78e0-c813-4d2f-bb82-dc4b11debba0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:30.127077 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-de4f78e0-c813-4d2f-bb82-dc4b11debba0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:30.127503 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-de4f78e0-c813-4d2f-bb82-dc4b11debba0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:30.263472 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-de4f78e0-c813-4d2f-bb82-dc4b11debba0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:30.269174 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-4f8b7b8e-072b-4668-b739-eb1327fcd1fd tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:30.271566 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-4f8b7b8e-072b-4668-b739-eb1327fcd1fd tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:30.272292 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-de4f78e0-c813-4d2f-bb82-dc4b11debba0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:30.273815 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-de4f78e0-c813-4d2f-bb82-dc4b11debba0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:30.274758 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:24:30.274978 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-de4f78e0-c813-4d2f-bb82-dc4b11debba0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1731 microversion: 2.20 time: 0.168914 Aug 09 11:24:30.275535 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 439/907] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:24:30 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:24:30.280083 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4f8b7b8e-072b-4668-b739-eb1327fcd1fd tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:30.280588 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4f8b7b8e-072b-4668-b739-eb1327fcd1fd tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:30.281430 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4f8b7b8e-072b-4668-b739-eb1327fcd1fd tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:30.281699 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4f8b7b8e-072b-4668-b739-eb1327fcd1fd tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:30.282143 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4f8b7b8e-072b-4668-b739-eb1327fcd1fd tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:30.282561 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4f8b7b8e-072b-4668-b739-eb1327fcd1fd tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:30.311742 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-4f8b7b8e-072b-4668-b739-eb1327fcd1fd tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047650 Aug 09 11:24:30.312382 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 469/908] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 9 11:24:30 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:24:31.298846 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-b316dd26-89f0-43c0-90f6-65d9ed185152 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:31.299425 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-b316dd26-89f0-43c0-90f6-65d9ed185152 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:31.306473 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b316dd26-89f0-43c0-90f6-65d9ed185152 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:31.306959 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b316dd26-89f0-43c0-90f6-65d9ed185152 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:31.307400 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b316dd26-89f0-43c0-90f6-65d9ed185152 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:31.308100 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b316dd26-89f0-43c0-90f6-65d9ed185152 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:31.308597 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b316dd26-89f0-43c0-90f6-65d9ed185152 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:31.309029 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b316dd26-89f0-43c0-90f6-65d9ed185152 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:31.325118 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-407b0bf2-5d06-4c74-965c-58ffe4432c4c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:31.327296 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-407b0bf2-5d06-4c74-965c-58ffe4432c4c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:31.334470 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-407b0bf2-5d06-4c74-965c-58ffe4432c4c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:31.334956 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-407b0bf2-5d06-4c74-965c-58ffe4432c4c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:31.335384 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-407b0bf2-5d06-4c74-965c-58ffe4432c4c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:31.336076 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-407b0bf2-5d06-4c74-965c-58ffe4432c4c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:31.336547 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-407b0bf2-5d06-4c74-965c-58ffe4432c4c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:31.336945 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-407b0bf2-5d06-4c74-965c-58ffe4432c4c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:31.369584 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-407b0bf2-5d06-4c74-965c-58ffe4432c4c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048718 Aug 09 11:24:31.369869 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 470/909] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 9 11:24:31 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:24:31.451937 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-b316dd26-89f0-43c0-90f6-65d9ed185152 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:31.460382 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-b316dd26-89f0-43c0-90f6-65d9ed185152 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:31.461895 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-b316dd26-89f0-43c0-90f6-65d9ed185152 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:31.463059 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-b316dd26-89f0-43c0-90f6-65d9ed185152 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1731 microversion: 2.20 time: 0.168404 Aug 09 11:24:31.472240 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 440/910] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:24:31 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:24:32.178867 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-acae6bc1-71fa-47a1-886c-c18551f75572 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:32.181101 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-acae6bc1-71fa-47a1-886c-c18551f75572 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: 6c6b7435-b965-416a-ae82-7eb037cc7152] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:32.187564 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-acae6bc1-71fa-47a1-886c-c18551f75572 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:32.188050 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-acae6bc1-71fa-47a1-886c-c18551f75572 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:32.188507 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-acae6bc1-71fa-47a1-886c-c18551f75572 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:32.189430 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-acae6bc1-71fa-47a1-886c-c18551f75572 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:32.189657 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-acae6bc1-71fa-47a1-886c-c18551f75572 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:32.190077 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-acae6bc1-71fa-47a1-886c-c18551f75572 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:32.225141 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-acae6bc1-71fa-47a1-886c-c18551f75572 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050130 Aug 09 11:24:32.228774 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 471/911] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 9 11:24:32 2022] GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 11:24:32.358281 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-e76fe622-30f6-4bd3-982b-2adedabb8035 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:32.360539 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-e76fe622-30f6-4bd3-982b-2adedabb8035 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: 6c6b7435-b965-416a-ae82-7eb037cc7152] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:32.366879 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e76fe622-30f6-4bd3-982b-2adedabb8035 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:32.367361 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e76fe622-30f6-4bd3-982b-2adedabb8035 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:32.367794 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e76fe622-30f6-4bd3-982b-2adedabb8035 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:32.368520 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e76fe622-30f6-4bd3-982b-2adedabb8035 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:32.368973 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e76fe622-30f6-4bd3-982b-2adedabb8035 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:32.369394 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e76fe622-30f6-4bd3-982b-2adedabb8035 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:32.381927 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-34978f50-e3d3-4d0c-80a5-456b5c627def tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:32.384201 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-34978f50-e3d3-4d0c-80a5-456b5c627def tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:32.390236 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-34978f50-e3d3-4d0c-80a5-456b5c627def tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:32.390715 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-34978f50-e3d3-4d0c-80a5-456b5c627def tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:32.391137 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-34978f50-e3d3-4d0c-80a5-456b5c627def tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:32.391825 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-34978f50-e3d3-4d0c-80a5-456b5c627def tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:32.392277 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-34978f50-e3d3-4d0c-80a5-456b5c627def tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:32.392765 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-34978f50-e3d3-4d0c-80a5-456b5c627def tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:32.399200 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-e76fe622-30f6-4bd3-982b-2adedabb8035 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044932 Aug 09 11:24:32.399763 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 441/912] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 9 11:24:32 2022] GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 11:24:32.423380 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-34978f50-e3d3-4d0c-80a5-456b5c627def tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045511 Aug 09 11:24:32.423946 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 472/913] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 9 11:24:32 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 09 11:24:32.462552 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-0d51e4de-a0c1-4146-a868-08293e345a73 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:32.462994 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-0d51e4de-a0c1-4146-a868-08293e345a73 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: 6c6b7435-b965-416a-ae82-7eb037cc7152] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:32.469511 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0d51e4de-a0c1-4146-a868-08293e345a73 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:32.469911 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0d51e4de-a0c1-4146-a868-08293e345a73 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:32.470339 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0d51e4de-a0c1-4146-a868-08293e345a73 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:32.471027 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0d51e4de-a0c1-4146-a868-08293e345a73 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:32.471553 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0d51e4de-a0c1-4146-a868-08293e345a73 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:32.471998 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0d51e4de-a0c1-4146-a868-08293e345a73 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:32.492557 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-8a4cb7f3-23f2-4724-811a-82b54a529d99 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:32.492557 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-8a4cb7f3-23f2-4724-811a-82b54a529d99 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:32.496166 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8a4cb7f3-23f2-4724-811a-82b54a529d99 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:32.496806 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8a4cb7f3-23f2-4724-811a-82b54a529d99 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:32.497371 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8a4cb7f3-23f2-4724-811a-82b54a529d99 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:32.498141 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8a4cb7f3-23f2-4724-811a-82b54a529d99 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:32.498588 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8a4cb7f3-23f2-4724-811a-82b54a529d99 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:32.498702 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-0d51e4de-a0c1-4146-a868-08293e345a73 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: 6c6b7435-b965-416a-ae82-7eb037cc7152] Going to try to terminate instance {{(pid=117684) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 11:24:32.499035 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8a4cb7f3-23f2-4724-811a-82b54a529d99 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:32.583123 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-0d51e4de-a0c1-4146-a868-08293e345a73 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152" status: 204 len: 0 microversion: 2.1 time: 0.124276 Aug 09 11:24:32.584206 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 442/914] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 9 11:24:32 2022] DELETE /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 11:24:32.593973 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-b0876bba-2db0-44b3-bb64-de864b0b48bc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:32.594573 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-b0876bba-2db0-44b3-bb64-de864b0b48bc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:32.603081 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b0876bba-2db0-44b3-bb64-de864b0b48bc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:32.603748 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b0876bba-2db0-44b3-bb64-de864b0b48bc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:32.604240 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b0876bba-2db0-44b3-bb64-de864b0b48bc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:32.605038 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b0876bba-2db0-44b3-bb64-de864b0b48bc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:32.605592 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b0876bba-2db0-44b3-bb64-de864b0b48bc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:32.606012 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b0876bba-2db0-44b3-bb64-de864b0b48bc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:32.634025 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-b0876bba-2db0-44b3-bb64-de864b0b48bc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Going to try to terminate instance {{(pid=117684) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 11:24:32.648076 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-8a4cb7f3-23f2-4724-811a-82b54a529d99 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:32.657040 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-8a4cb7f3-23f2-4724-811a-82b54a529d99 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:32.658595 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-8a4cb7f3-23f2-4724-811a-82b54a529d99 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:32.660009 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-8a4cb7f3-23f2-4724-811a-82b54a529d99 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1731 microversion: 2.20 time: 0.177153 Aug 09 11:24:32.660605 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 473/915] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:24:32 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 11:24:32.665523 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-3eb65437-f666-4eb6-9fc6-3ae2bde7e0f1 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:32.666129 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-3eb65437-f666-4eb6-9fc6-3ae2bde7e0f1 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: 6c6b7435-b965-416a-ae82-7eb037cc7152] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:32.672159 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3eb65437-f666-4eb6-9fc6-3ae2bde7e0f1 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:32.672948 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3eb65437-f666-4eb6-9fc6-3ae2bde7e0f1 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:32.673585 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3eb65437-f666-4eb6-9fc6-3ae2bde7e0f1 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:32.674511 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3eb65437-f666-4eb6-9fc6-3ae2bde7e0f1 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:32.675296 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3eb65437-f666-4eb6-9fc6-3ae2bde7e0f1 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:32.675815 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3eb65437-f666-4eb6-9fc6-3ae2bde7e0f1 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:32.733938 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-b0876bba-2db0-44b3-bb64-de864b0b48bc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078" status: 204 len: 0 microversion: 2.1 time: 0.147860 Aug 09 11:24:32.737871 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 443/916] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 9 11:24:32 2022] DELETE /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 11:24:32.743399 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-9bf73e8e-fdc6-4d2a-9f3a-e6a159b4fca2 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:32.744093 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-9bf73e8e-fdc6-4d2a-9f3a-e6a159b4fca2 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:32.750983 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9bf73e8e-fdc6-4d2a-9f3a-e6a159b4fca2 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:32.751464 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9bf73e8e-fdc6-4d2a-9f3a-e6a159b4fca2 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:32.751904 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9bf73e8e-fdc6-4d2a-9f3a-e6a159b4fca2 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:32.752702 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9bf73e8e-fdc6-4d2a-9f3a-e6a159b4fca2 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:32.753060 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9bf73e8e-fdc6-4d2a-9f3a-e6a159b4fca2 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:32.753835 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9bf73e8e-fdc6-4d2a-9f3a-e6a159b4fca2 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:32.758315 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:24:32.844143 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-3eb65437-f666-4eb6-9fc6-3ae2bde7e0f1 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:32.851832 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-3eb65437-f666-4eb6-9fc6-3ae2bde7e0f1 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152" status: 200 len: 1675 microversion: 2.1 time: 0.189881 Aug 09 11:24:32.852590 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 474/917] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:24:32 2022] GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152 => generated 1675 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:24:32.908369 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-9bf73e8e-fdc6-4d2a-9f3a-e6a159b4fca2 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:32.916448 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-9bf73e8e-fdc6-4d2a-9f3a-e6a159b4fca2 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078" status: 200 len: 1688 microversion: 2.1 time: 0.177218 Aug 09 11:24:32.917013 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 444/918] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:24:32 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 => generated 1688 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:24:33.687142 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-a5ae6d6d-3dcf-4c87-8be2-eca11d5a62a5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:33.688587 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-a5ae6d6d-3dcf-4c87-8be2-eca11d5a62a5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:33.695444 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a5ae6d6d-3dcf-4c87-8be2-eca11d5a62a5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:33.695953 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a5ae6d6d-3dcf-4c87-8be2-eca11d5a62a5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:33.696441 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a5ae6d6d-3dcf-4c87-8be2-eca11d5a62a5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:33.697178 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a5ae6d6d-3dcf-4c87-8be2-eca11d5a62a5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:33.697646 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a5ae6d6d-3dcf-4c87-8be2-eca11d5a62a5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:33.698087 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a5ae6d6d-3dcf-4c87-8be2-eca11d5a62a5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:33.837301 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-a5ae6d6d-3dcf-4c87-8be2-eca11d5a62a5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:33.845526 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-a5ae6d6d-3dcf-4c87-8be2-eca11d5a62a5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:33.847029 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-a5ae6d6d-3dcf-4c87-8be2-eca11d5a62a5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:33.848184 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-a5ae6d6d-3dcf-4c87-8be2-eca11d5a62a5 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1731 microversion: 2.20 time: 0.167811 Aug 09 11:24:33.848798 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 475/919] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:24:33 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:24:33.877256 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-179b2b8d-0334-472f-a6e5-25e59ef9d245 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:33.877842 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-179b2b8d-0334-472f-a6e5-25e59ef9d245 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: 6c6b7435-b965-416a-ae82-7eb037cc7152] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:33.884841 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-179b2b8d-0334-472f-a6e5-25e59ef9d245 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:33.885313 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-179b2b8d-0334-472f-a6e5-25e59ef9d245 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:33.885739 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-179b2b8d-0334-472f-a6e5-25e59ef9d245 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:33.886417 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-179b2b8d-0334-472f-a6e5-25e59ef9d245 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:33.886868 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-179b2b8d-0334-472f-a6e5-25e59ef9d245 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:33.887278 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-179b2b8d-0334-472f-a6e5-25e59ef9d245 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:33.939260 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-7a0ac387-f53c-4ca3-bb30-ef706765c4a8 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:33.939775 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-7a0ac387-f53c-4ca3-bb30-ef706765c4a8 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:33.946063 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7a0ac387-f53c-4ca3-bb30-ef706765c4a8 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:33.946548 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7a0ac387-f53c-4ca3-bb30-ef706765c4a8 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:33.946979 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7a0ac387-f53c-4ca3-bb30-ef706765c4a8 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:33.947680 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7a0ac387-f53c-4ca3-bb30-ef706765c4a8 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:33.948129 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7a0ac387-f53c-4ca3-bb30-ef706765c4a8 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:33.948668 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7a0ac387-f53c-4ca3-bb30-ef706765c4a8 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:34.073664 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-179b2b8d-0334-472f-a6e5-25e59ef9d245 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:34.081788 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-179b2b8d-0334-472f-a6e5-25e59ef9d245 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152" status: 200 len: 1675 microversion: 2.1 time: 0.210114 Aug 09 11:24:34.082361 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 445/920] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:24:33 2022] GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152 => generated 1675 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:24:34.108835 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-7a0ac387-f53c-4ca3-bb30-ef706765c4a8 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:34.116978 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-7a0ac387-f53c-4ca3-bb30-ef706765c4a8 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078" status: 200 len: 1688 microversion: 2.1 time: 0.182129 Aug 09 11:24:34.117522 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 476/921] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:24:33 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 => generated 1688 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:24:34.281031 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [req-69737ec4-c083-413e-bbd0-3e8b58c290a8 req-078d0f35-b071-44f9-9903-3b876d4884ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "919c3009-894a-45e2-bc25-24df397fa3d0", "name": "network-vif-plugged", "status": "completed", "tag": "2572315b-325e-49c1-b65d-1b98ef984660"}]} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:24:34.291862 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-69737ec4-c083-413e-bbd0-3e8b58c290a8 req-078d0f35-b071-44f9-9903-3b876d4884ff service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:34.292372 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-69737ec4-c083-413e-bbd0-3e8b58c290a8 req-078d0f35-b071-44f9-9903-3b876d4884ff service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:34.292804 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-69737ec4-c083-413e-bbd0-3e8b58c290a8 req-078d0f35-b071-44f9-9903-3b876d4884ff service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:34.304128 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.compute.server_external_events [req-69737ec4-c083-413e-bbd0-3e8b58c290a8 req-078d0f35-b071-44f9-9903-3b876d4884ff service nova] Creating event network-vif-plugged:2572315b-325e-49c1-b65d-1b98ef984660 for instance 919c3009-894a-45e2-bc25-24df397fa3d0 on hv-cinder-85251 Aug 09 11:24:34.309204 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [req-69737ec4-c083-413e-bbd0-3e8b58c290a8 req-078d0f35-b071-44f9-9903-3b876d4884ff service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035410 Aug 09 11:24:34.309971 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 446/922] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:24:34.875374 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-2836565a-4e35-4f99-a1d6-4bd5745b230d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:34.876706 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-2836565a-4e35-4f99-a1d6-4bd5745b230d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:34.887618 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2836565a-4e35-4f99-a1d6-4bd5745b230d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:34.888471 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2836565a-4e35-4f99-a1d6-4bd5745b230d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:34.889197 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2836565a-4e35-4f99-a1d6-4bd5745b230d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:34.890343 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2836565a-4e35-4f99-a1d6-4bd5745b230d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:34.891103 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2836565a-4e35-4f99-a1d6-4bd5745b230d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:34.892379 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2836565a-4e35-4f99-a1d6-4bd5745b230d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:35.028153 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-2836565a-4e35-4f99-a1d6-4bd5745b230d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:35.036128 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-2836565a-4e35-4f99-a1d6-4bd5745b230d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:35.037642 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-2836565a-4e35-4f99-a1d6-4bd5745b230d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:35.038766 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-2836565a-4e35-4f99-a1d6-4bd5745b230d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1731 microversion: 2.20 time: 0.170147 Aug 09 11:24:35.039325 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 477/923] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:24:34 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:24:35.104351 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-b1fba1d9-4343-4c16-98f9-8944b439f190 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:35.105040 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-b1fba1d9-4343-4c16-98f9-8944b439f190 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: 6c6b7435-b965-416a-ae82-7eb037cc7152] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:35.112627 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b1fba1d9-4343-4c16-98f9-8944b439f190 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:35.113113 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b1fba1d9-4343-4c16-98f9-8944b439f190 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:35.113585 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b1fba1d9-4343-4c16-98f9-8944b439f190 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:35.114279 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b1fba1d9-4343-4c16-98f9-8944b439f190 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:35.114750 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b1fba1d9-4343-4c16-98f9-8944b439f190 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:35.115178 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b1fba1d9-4343-4c16-98f9-8944b439f190 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:35.138130 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-44c0c1fa-f350-44e4-ac13-75eddd0a1995 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:35.138653 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-44c0c1fa-f350-44e4-ac13-75eddd0a1995 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:35.145289 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-44c0c1fa-f350-44e4-ac13-75eddd0a1995 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:35.145773 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-44c0c1fa-f350-44e4-ac13-75eddd0a1995 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:35.146197 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-44c0c1fa-f350-44e4-ac13-75eddd0a1995 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:35.146881 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-44c0c1fa-f350-44e4-ac13-75eddd0a1995 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:35.147674 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-44c0c1fa-f350-44e4-ac13-75eddd0a1995 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:35.148088 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-44c0c1fa-f350-44e4-ac13-75eddd0a1995 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:35.308184 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-b1fba1d9-4343-4c16-98f9-8944b439f190 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:35.316443 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-b1fba1d9-4343-4c16-98f9-8944b439f190 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152" status: 200 len: 1675 microversion: 2.1 time: 0.216829 Aug 09 11:24:35.317154 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 447/924] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:24:35 2022] GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152 => generated 1675 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:24:35.345071 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-44c0c1fa-f350-44e4-ac13-75eddd0a1995 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:35.353143 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-44c0c1fa-f350-44e4-ac13-75eddd0a1995 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078" status: 200 len: 1688 microversion: 2.1 time: 0.218955 Aug 09 11:24:35.353759 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 478/925] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:24:35 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 => generated 1688 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:24:36.062504 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-765bdb23-e470-4e1e-998c-0d94969ad77e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:36.063109 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-765bdb23-e470-4e1e-998c-0d94969ad77e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:36.070428 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-765bdb23-e470-4e1e-998c-0d94969ad77e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:36.070909 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-765bdb23-e470-4e1e-998c-0d94969ad77e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:36.071340 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-765bdb23-e470-4e1e-998c-0d94969ad77e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:36.072027 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-765bdb23-e470-4e1e-998c-0d94969ad77e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:36.072511 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-765bdb23-e470-4e1e-998c-0d94969ad77e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:36.072929 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-765bdb23-e470-4e1e-998c-0d94969ad77e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:36.224773 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-765bdb23-e470-4e1e-998c-0d94969ad77e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:36.236856 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-765bdb23-e470-4e1e-998c-0d94969ad77e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:36.238341 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-765bdb23-e470-4e1e-998c-0d94969ad77e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:36.239594 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-765bdb23-e470-4e1e-998c-0d94969ad77e tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1731 microversion: 2.20 time: 0.181129 Aug 09 11:24:36.240135 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 448/926] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:24:36 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1731 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 11:24:36.338616 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-a3c99e75-0a23-4ce2-bb16-b7836916c1d9 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:36.339834 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-a3c99e75-0a23-4ce2-bb16-b7836916c1d9 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: 6c6b7435-b965-416a-ae82-7eb037cc7152] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:36.347330 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a3c99e75-0a23-4ce2-bb16-b7836916c1d9 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:36.347826 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a3c99e75-0a23-4ce2-bb16-b7836916c1d9 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:36.348301 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a3c99e75-0a23-4ce2-bb16-b7836916c1d9 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:36.349061 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a3c99e75-0a23-4ce2-bb16-b7836916c1d9 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:36.349513 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a3c99e75-0a23-4ce2-bb16-b7836916c1d9 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:36.349935 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a3c99e75-0a23-4ce2-bb16-b7836916c1d9 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:36.374578 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-6c107d6a-b240-4d08-aea4-b04eacfc35bc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:36.375380 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-6c107d6a-b240-4d08-aea4-b04eacfc35bc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:36.382196 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6c107d6a-b240-4d08-aea4-b04eacfc35bc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:36.382803 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6c107d6a-b240-4d08-aea4-b04eacfc35bc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:36.383332 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6c107d6a-b240-4d08-aea4-b04eacfc35bc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:36.384120 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6c107d6a-b240-4d08-aea4-b04eacfc35bc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:36.384661 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6c107d6a-b240-4d08-aea4-b04eacfc35bc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:36.385161 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6c107d6a-b240-4d08-aea4-b04eacfc35bc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:36.534181 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-a3c99e75-0a23-4ce2-bb16-b7836916c1d9 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:36.542244 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-a3c99e75-0a23-4ce2-bb16-b7836916c1d9 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152" status: 200 len: 1675 microversion: 2.1 time: 0.207465 Aug 09 11:24:36.542833 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 479/927] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:24:36 2022] GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152 => generated 1675 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:24:36.561518 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-6c107d6a-b240-4d08-aea4-b04eacfc35bc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:36.570365 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-6c107d6a-b240-4d08-aea4-b04eacfc35bc tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078" status: 200 len: 1688 microversion: 2.1 time: 0.199907 Aug 09 11:24:36.570930 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 449/928] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:24:36 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 => generated 1688 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:24:37.267032 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-70e9859c-eb8c-4db6-8f62-aa1e4446e026 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:37.268054 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-70e9859c-eb8c-4db6-8f62-aa1e4446e026 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:37.275165 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-70e9859c-eb8c-4db6-8f62-aa1e4446e026 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:37.275712 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-70e9859c-eb8c-4db6-8f62-aa1e4446e026 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:37.276139 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-70e9859c-eb8c-4db6-8f62-aa1e4446e026 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:37.276883 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-70e9859c-eb8c-4db6-8f62-aa1e4446e026 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:37.277371 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-70e9859c-eb8c-4db6-8f62-aa1e4446e026 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:37.277971 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-70e9859c-eb8c-4db6-8f62-aa1e4446e026 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:37.424539 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-70e9859c-eb8c-4db6-8f62-aa1e4446e026 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:37.433794 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-70e9859c-eb8c-4db6-8f62-aa1e4446e026 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:37.435340 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-70e9859c-eb8c-4db6-8f62-aa1e4446e026 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:37.436703 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-70e9859c-eb8c-4db6-8f62-aa1e4446e026 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1731 microversion: 2.20 time: 0.176564 Aug 09 11:24:37.448209 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 480/929] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:24:37 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1731 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:24:37.567411 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-b5c92c9b-f227-47b0-8384-e78ddac5124b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:37.567992 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-b5c92c9b-f227-47b0-8384-e78ddac5124b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: 6c6b7435-b965-416a-ae82-7eb037cc7152] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:37.574891 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b5c92c9b-f227-47b0-8384-e78ddac5124b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:37.575351 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b5c92c9b-f227-47b0-8384-e78ddac5124b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:37.575809 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b5c92c9b-f227-47b0-8384-e78ddac5124b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:37.576546 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b5c92c9b-f227-47b0-8384-e78ddac5124b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:37.577009 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b5c92c9b-f227-47b0-8384-e78ddac5124b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:37.577434 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b5c92c9b-f227-47b0-8384-e78ddac5124b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:37.591016 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-55018f35-f55f-4624-8783-3e0d00cad4b3 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:37.591724 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-55018f35-f55f-4624-8783-3e0d00cad4b3 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:37.598173 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-55018f35-f55f-4624-8783-3e0d00cad4b3 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:37.598966 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-55018f35-f55f-4624-8783-3e0d00cad4b3 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:37.599520 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-55018f35-f55f-4624-8783-3e0d00cad4b3 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:37.600226 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-55018f35-f55f-4624-8783-3e0d00cad4b3 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:37.600687 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-55018f35-f55f-4624-8783-3e0d00cad4b3 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:37.601122 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-55018f35-f55f-4624-8783-3e0d00cad4b3 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:37.779675 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-b5c92c9b-f227-47b0-8384-e78ddac5124b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:37.788261 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-b5c92c9b-f227-47b0-8384-e78ddac5124b tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152" status: 200 len: 1675 microversion: 2.1 time: 0.227079 Aug 09 11:24:37.788864 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 450/930] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:24:37 2022] GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152 => generated 1675 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:24:37.792227 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-55018f35-f55f-4624-8783-3e0d00cad4b3 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:37.800708 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-55018f35-f55f-4624-8783-3e0d00cad4b3 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078" status: 200 len: 1688 microversion: 2.1 time: 0.213451 Aug 09 11:24:37.801352 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 481/931] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:24:37 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 => generated 1688 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:24:38.467296 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-54b16a50-c42f-4b43-95f2-5c24dad3b73b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:38.469737 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-54b16a50-c42f-4b43-95f2-5c24dad3b73b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:38.480738 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-54b16a50-c42f-4b43-95f2-5c24dad3b73b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:38.481232 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-54b16a50-c42f-4b43-95f2-5c24dad3b73b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:38.481679 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-54b16a50-c42f-4b43-95f2-5c24dad3b73b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:38.482427 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-54b16a50-c42f-4b43-95f2-5c24dad3b73b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:38.485476 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-54b16a50-c42f-4b43-95f2-5c24dad3b73b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:38.486004 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-54b16a50-c42f-4b43-95f2-5c24dad3b73b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:38.738643 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-54b16a50-c42f-4b43-95f2-5c24dad3b73b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:38.746889 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-54b16a50-c42f-4b43-95f2-5c24dad3b73b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:38.748447 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-54b16a50-c42f-4b43-95f2-5c24dad3b73b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:38.749632 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-54b16a50-c42f-4b43-95f2-5c24dad3b73b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1731 microversion: 2.20 time: 0.292600 Aug 09 11:24:38.750513 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 451/932] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:24:38 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1731 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:24:38.815303 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-35e4bc05-3b68-4b47-9bd1-dfa17c80eaac tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:38.815912 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-35e4bc05-3b68-4b47-9bd1-dfa17c80eaac tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: 6c6b7435-b965-416a-ae82-7eb037cc7152] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:38.822170 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-27b0db74-03b4-4c37-946d-e10bad2d324f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:38.823023 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-35e4bc05-3b68-4b47-9bd1-dfa17c80eaac tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:38.823511 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-35e4bc05-3b68-4b47-9bd1-dfa17c80eaac tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:38.823740 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-27b0db74-03b4-4c37-946d-e10bad2d324f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:38.823949 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-35e4bc05-3b68-4b47-9bd1-dfa17c80eaac tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:38.824673 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-35e4bc05-3b68-4b47-9bd1-dfa17c80eaac tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:38.825122 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-35e4bc05-3b68-4b47-9bd1-dfa17c80eaac tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:38.825542 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-35e4bc05-3b68-4b47-9bd1-dfa17c80eaac tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:38.831924 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-27b0db74-03b4-4c37-946d-e10bad2d324f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:38.832803 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-27b0db74-03b4-4c37-946d-e10bad2d324f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:38.833620 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-27b0db74-03b4-4c37-946d-e10bad2d324f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:38.835645 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-27b0db74-03b4-4c37-946d-e10bad2d324f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:38.836360 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-27b0db74-03b4-4c37-946d-e10bad2d324f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:38.837252 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-27b0db74-03b4-4c37-946d-e10bad2d324f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:39.135239 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-27b0db74-03b4-4c37-946d-e10bad2d324f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:39.140187 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-35e4bc05-3b68-4b47-9bd1-dfa17c80eaac tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:39.143776 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-27b0db74-03b4-4c37-946d-e10bad2d324f tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078" status: 200 len: 1688 microversion: 2.1 time: 0.326079 Aug 09 11:24:39.158825 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 452/933] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:24:38 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 => generated 1688 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:24:39.159894 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-35e4bc05-3b68-4b47-9bd1-dfa17c80eaac tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152" status: 200 len: 1675 microversion: 2.1 time: 0.342074 Aug 09 11:24:39.160728 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 482/934] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:24:38 2022] GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152 => generated 1675 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:24:39.302720 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [req-281a9929-c8eb-4476-b1b0-9eaaac321e75 req-57b35c5d-27f8-4d24-a613-9a9c0f2c61e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c6b7435-b965-416a-ae82-7eb037cc7152", "name": "network-vif-deleted", "tag": "42ae7264-9701-4213-88ec-bfd261319ae9"}]} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:24:39.312803 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-281a9929-c8eb-4476-b1b0-9eaaac321e75 req-57b35c5d-27f8-4d24-a613-9a9c0f2c61e7 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:39.313356 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-281a9929-c8eb-4476-b1b0-9eaaac321e75 req-57b35c5d-27f8-4d24-a613-9a9c0f2c61e7 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:39.313911 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-281a9929-c8eb-4476-b1b0-9eaaac321e75 req-57b35c5d-27f8-4d24-a613-9a9c0f2c61e7 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:39.326659 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.compute.server_external_events [req-281a9929-c8eb-4476-b1b0-9eaaac321e75 req-57b35c5d-27f8-4d24-a613-9a9c0f2c61e7 service nova] Creating event network-vif-deleted:42ae7264-9701-4213-88ec-bfd261319ae9 for instance 6c6b7435-b965-416a-ae82-7eb037cc7152 on hv-cinder-85251 Aug 09 11:24:39.332118 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [req-281a9929-c8eb-4476-b1b0-9eaaac321e75 req-57b35c5d-27f8-4d24-a613-9a9c0f2c61e7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033301 Aug 09 11:24:39.333068 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 453/935] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:24:39.666009 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-ffe5dbd4-75e3-4073-99b3-e16a337ef176 req-53f7ca75-d771-4b47-9167-80404d1c5960 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8009a1a2-4c8e-4953-ba5c-faab2db05078", "name": "network-vif-deleted", "tag": "13fa53bd-98eb-4624-884c-1b14e8d98ae7"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:24:39.682825 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-ffe5dbd4-75e3-4073-99b3-e16a337ef176 req-53f7ca75-d771-4b47-9167-80404d1c5960 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:39.685474 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-ffe5dbd4-75e3-4073-99b3-e16a337ef176 req-53f7ca75-d771-4b47-9167-80404d1c5960 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:39.686048 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-ffe5dbd4-75e3-4073-99b3-e16a337ef176 req-53f7ca75-d771-4b47-9167-80404d1c5960 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:39.710679 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-ffe5dbd4-75e3-4073-99b3-e16a337ef176 req-53f7ca75-d771-4b47-9167-80404d1c5960 service nova] Creating event network-vif-deleted:13fa53bd-98eb-4624-884c-1b14e8d98ae7 for instance 8009a1a2-4c8e-4953-ba5c-faab2db05078 on hv-cinder-85251 Aug 09 11:24:39.723371 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-ffe5dbd4-75e3-4073-99b3-e16a337ef176 req-53f7ca75-d771-4b47-9167-80404d1c5960 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061071 Aug 09 11:24:39.723932 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 483/936] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:24:39.775568 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-c3595124-2c13-4a3f-a760-7a605756a61f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:39.776399 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-c3595124-2c13-4a3f-a760-7a605756a61f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:39.786880 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:24:39.789152 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c3595124-2c13-4a3f-a760-7a605756a61f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:39.789762 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c3595124-2c13-4a3f-a760-7a605756a61f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:39.791885 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c3595124-2c13-4a3f-a760-7a605756a61f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:39.791885 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c3595124-2c13-4a3f-a760-7a605756a61f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:39.792535 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c3595124-2c13-4a3f-a760-7a605756a61f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:39.793058 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c3595124-2c13-4a3f-a760-7a605756a61f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:39.864087 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-0dd79e25-7b79-467a-973c-97d3bec5be53 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:39.864670 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-0dd79e25-7b79-467a-973c-97d3bec5be53 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 92aed47a-39ca-4174-9ae4-b99c2fb029e1] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:39.881438 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0dd79e25-7b79-467a-973c-97d3bec5be53 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:39.882215 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0dd79e25-7b79-467a-973c-97d3bec5be53 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:39.882873 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0dd79e25-7b79-467a-973c-97d3bec5be53 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:39.884370 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0dd79e25-7b79-467a-973c-97d3bec5be53 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:39.885642 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0dd79e25-7b79-467a-973c-97d3bec5be53 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:39.886600 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0dd79e25-7b79-467a-973c-97d3bec5be53 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:40.018579 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-c3595124-2c13-4a3f-a760-7a605756a61f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:40.019199 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:24:40.021711 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.objects.instance [None req-0dd79e25-7b79-467a-973c-97d3bec5be53 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lazy-loading 'services' on Instance uuid 92aed47a-39ca-4174-9ae4-b99c2fb029e1 {{(pid=117685) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:24:40.042803 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-c3595124-2c13-4a3f-a760-7a605756a61f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:40.051286 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-c3595124-2c13-4a3f-a760-7a605756a61f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:40.052601 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-c3595124-2c13-4a3f-a760-7a605756a61f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1731 microversion: 2.20 time: 0.283936 Aug 09 11:24:40.056082 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 454/937] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:24:39 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1731 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:24:40.135153 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-0dd79e25-7b79-467a-973c-97d3bec5be53 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "DELETE /compute/v2.1/servers/92aed47a-39ca-4174-9ae4-b99c2fb029e1/os-volume_attachments/6621810c-32bd-42a2-98db-989f0be44e5f" status: 202 len: 0 microversion: 2.1 time: 0.276407 Aug 09 11:24:40.137114 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 484/938] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Aug 9 11:24:39 2022] DELETE /compute/v2.1/servers/92aed47a-39ca-4174-9ae4-b99c2fb029e1/os-volume_attachments/6621810c-32bd-42a2-98db-989f0be44e5f => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:24:40.145643 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-7d2b9dc3-53de-4762-8328-e111da68ab08 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:40.148115 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-7d2b9dc3-53de-4762-8328-e111da68ab08 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 92aed47a-39ca-4174-9ae4-b99c2fb029e1] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:40.154525 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7d2b9dc3-53de-4762-8328-e111da68ab08 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:40.155242 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7d2b9dc3-53de-4762-8328-e111da68ab08 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:40.155983 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7d2b9dc3-53de-4762-8328-e111da68ab08 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:40.157283 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7d2b9dc3-53de-4762-8328-e111da68ab08 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:40.157924 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7d2b9dc3-53de-4762-8328-e111da68ab08 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:40.160881 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7d2b9dc3-53de-4762-8328-e111da68ab08 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:40.167640 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-bfbba90a-f888-46bf-a487-5b7924c283d1 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:40.168593 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-bfbba90a-f888-46bf-a487-5b7924c283d1 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:40.176361 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bfbba90a-f888-46bf-a487-5b7924c283d1 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:40.177131 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bfbba90a-f888-46bf-a487-5b7924c283d1 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:40.177717 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bfbba90a-f888-46bf-a487-5b7924c283d1 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:40.178683 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bfbba90a-f888-46bf-a487-5b7924c283d1 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:40.179966 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bfbba90a-f888-46bf-a487-5b7924c283d1 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:40.180744 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bfbba90a-f888-46bf-a487-5b7924c283d1 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:40.206626 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-7d2b9dc3-53de-4762-8328-e111da68ab08 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/92aed47a-39ca-4174-9ae4-b99c2fb029e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065210 Aug 09 11:24:40.207223 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 455/939] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 9 11:24:40 2022] GET /compute/v2.1/servers/92aed47a-39ca-4174-9ae4-b99c2fb029e1/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:24:40.212095 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-ab5a5671-c8b9-4d3c-862e-c1b2bb8875e1 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:40.212833 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-ab5a5671-c8b9-4d3c-862e-c1b2bb8875e1 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: 6c6b7435-b965-416a-ae82-7eb037cc7152] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:40.219901 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ab5a5671-c8b9-4d3c-862e-c1b2bb8875e1 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:40.220708 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ab5a5671-c8b9-4d3c-862e-c1b2bb8875e1 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:40.221335 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ab5a5671-c8b9-4d3c-862e-c1b2bb8875e1 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:40.222544 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ab5a5671-c8b9-4d3c-862e-c1b2bb8875e1 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:40.223870 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ab5a5671-c8b9-4d3c-862e-c1b2bb8875e1 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:40.224998 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ab5a5671-c8b9-4d3c-862e-c1b2bb8875e1 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:40.263890 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-bfbba90a-f888-46bf-a487-5b7924c283d1 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:40.274683 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-bfbba90a-f888-46bf-a487-5b7924c283d1 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078" status: 200 len: 1329 microversion: 2.1 time: 0.111954 Aug 09 11:24:40.275690 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 485/940] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:24:40 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 => generated 1329 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:24:40.292931 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ab5a5671-c8b9-4d3c-862e-c1b2bb8875e1 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:40.293423 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ab5a5671-c8b9-4d3c-862e-c1b2bb8875e1 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:40.293858 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ab5a5671-c8b9-4d3c-862e-c1b2bb8875e1 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:40.294317 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.objects.instance [None req-ab5a5671-c8b9-4d3c-862e-c1b2bb8875e1 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lazy-loading 'fault' on Instance uuid 6c6b7435-b965-416a-ae82-7eb037cc7152 {{(pid=117684) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:24:40.340602 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-ab5a5671-c8b9-4d3c-862e-c1b2bb8875e1 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601782d5743c47f380358021be28cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06dd1efa43b043cf84f9808305d97bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:40.351128 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-ab5a5671-c8b9-4d3c-862e-c1b2bb8875e1 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152" status: 200 len: 1327 microversion: 2.1 time: 0.142514 Aug 09 11:24:40.351890 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 456/941] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:24:40 2022] GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152 => generated 1327 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:24:41.079000 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-003ffd19-b135-4211-acc6-cb717cd0a158 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:41.079687 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-003ffd19-b135-4211-acc6-cb717cd0a158 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:41.086772 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-003ffd19-b135-4211-acc6-cb717cd0a158 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:41.087255 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-003ffd19-b135-4211-acc6-cb717cd0a158 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:41.087687 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-003ffd19-b135-4211-acc6-cb717cd0a158 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:41.088403 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-003ffd19-b135-4211-acc6-cb717cd0a158 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:41.088847 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-003ffd19-b135-4211-acc6-cb717cd0a158 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:41.089249 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-003ffd19-b135-4211-acc6-cb717cd0a158 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:41.219371 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-94e98db2-e462-466c-8ee3-c265c53fcc22 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:41.222250 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-94e98db2-e462-466c-8ee3-c265c53fcc22 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 92aed47a-39ca-4174-9ae4-b99c2fb029e1] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:41.228702 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-94e98db2-e462-466c-8ee3-c265c53fcc22 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:41.229179 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-94e98db2-e462-466c-8ee3-c265c53fcc22 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:41.229602 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-94e98db2-e462-466c-8ee3-c265c53fcc22 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:41.230294 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-94e98db2-e462-466c-8ee3-c265c53fcc22 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:41.230739 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-94e98db2-e462-466c-8ee3-c265c53fcc22 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:41.231156 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-94e98db2-e462-466c-8ee3-c265c53fcc22 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:41.234223 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-003ffd19-b135-4211-acc6-cb717cd0a158 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:41.243468 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-003ffd19-b135-4211-acc6-cb717cd0a158 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:41.245232 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-003ffd19-b135-4211-acc6-cb717cd0a158 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:41.246503 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-003ffd19-b135-4211-acc6-cb717cd0a158 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1718 microversion: 2.20 time: 0.171655 Aug 09 11:24:41.247168 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 486/942] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:24:41 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1718 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:24:41.265677 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-94e98db2-e462-466c-8ee3-c265c53fcc22 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/92aed47a-39ca-4174-9ae4-b99c2fb029e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050241 Aug 09 11:24:41.266297 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 457/943] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 9 11:24:41 2022] GET /compute/v2.1/servers/92aed47a-39ca-4174-9ae4-b99c2fb029e1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:24:41.295269 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-bddae788-7629-4b34-841d-a09413161510 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:41.296113 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-bddae788-7629-4b34-841d-a09413161510 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:41.302525 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bddae788-7629-4b34-841d-a09413161510 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:41.303022 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bddae788-7629-4b34-841d-a09413161510 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:41.303796 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bddae788-7629-4b34-841d-a09413161510 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:41.304629 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bddae788-7629-4b34-841d-a09413161510 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:41.305147 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bddae788-7629-4b34-841d-a09413161510 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:41.305906 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bddae788-7629-4b34-841d-a09413161510 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:41.339734 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bddae788-7629-4b34-841d-a09413161510 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:41.340228 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bddae788-7629-4b34-841d-a09413161510 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:41.340687 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bddae788-7629-4b34-841d-a09413161510 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:41.341134 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.objects.instance [None req-bddae788-7629-4b34-841d-a09413161510 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lazy-loading 'fault' on Instance uuid 8009a1a2-4c8e-4953-ba5c-faab2db05078 {{(pid=117685) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:24:41.374628 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-0b5c7d6a-344a-42e0-9f9c-11f4fe6a68bb tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:41.375288 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-0b5c7d6a-344a-42e0-9f9c-11f4fe6a68bb tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: 6c6b7435-b965-416a-ae82-7eb037cc7152] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:41.381664 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0b5c7d6a-344a-42e0-9f9c-11f4fe6a68bb tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:41.382146 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0b5c7d6a-344a-42e0-9f9c-11f4fe6a68bb tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:41.382569 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0b5c7d6a-344a-42e0-9f9c-11f4fe6a68bb tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:41.383577 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0b5c7d6a-344a-42e0-9f9c-11f4fe6a68bb tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:41.384020 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0b5c7d6a-344a-42e0-9f9c-11f4fe6a68bb tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:41.384471 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0b5c7d6a-344a-42e0-9f9c-11f4fe6a68bb tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:41.385321 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-bddae788-7629-4b34-841d-a09413161510 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:41.392345 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-bddae788-7629-4b34-841d-a09413161510 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078" status: 200 len: 1334 microversion: 2.1 time: 0.101356 Aug 09 11:24:41.392928 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 487/944] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:24:41 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 => generated 1334 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:24:41.399194 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.wsgi [None req-0b5c7d6a-344a-42e0-9f9c-11f4fe6a68bb tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] HTTP exception thrown: Instance 6c6b7435-b965-416a-ae82-7eb037cc7152 could not be found. Aug 09 11:24:41.400882 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-0b5c7d6a-344a-42e0-9f9c-11f4fe6a68bb tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Request method failure captured: Aug 09 11:24:41.400882 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: request: GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152 HTTP/1.1 Aug 09 11:24:41.400882 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept: application/json Aug 09 11:24:41.400882 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept-Encoding: identity Aug 09 11:24:41.400882 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Connection: close Aug 09 11:24:41.400882 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Length: 0 Aug 09 11:24:41.400882 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Type: application/json Aug 09 11:24:41.400882 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Host: 10.222.0.27 Aug 09 11:24:41.400882 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Openstack-System-Scope: None Aug 09 11:24:41.400882 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: User-Agent: python-urllib3/1.26.11 Aug 09 11:24:41.400882 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Auth-Token: gAAAAABi8kJiP2rs-oyULagIWrQ8NK_q4zXCHu9nG4Fnlj5pti_3VSho1aiTw6A41IJOWnMplxYLUKxat19aejWmXOFV77R-MAOlKM-vVw982IRFRnt_0EpXq4kj4KyUHdG5ruXClspZmnaRjeV1WKqLODbLz7uBlJF1UQfZRiYelCeatKLyefE Aug 09 11:24:41.400882 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Id: None Aug 09 11:24:41.400882 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Name: None Aug 09 11:24:41.400882 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Identity-Status: Confirmed Aug 09 11:24:41.400882 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Is-Admin-Project: True Aug 09 11:24:41.400882 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Id: default Aug 09 11:24:41.400882 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Name: Default Aug 09 11:24:41.400882 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Id: 06dd1efa43b043cf84f9808305d97bf0 Aug 09 11:24:41.400882 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Name: tempest-AttachVolumeTestJSON-1041146077 Aug 09 11:24:41.400882 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Role: member,reader Aug 09 11:24:41.400882 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Roles: member,reader Aug 09 11:24:41.402492 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/06dd1efa43b043cf84f9808305d97bf0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_06dd1efa43b043cf84f9808305d97bf0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/06dd1efa43b043cf84f9808305d97bf0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/06dd1efa43b043cf84f9808305d97bf0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:24:41.402492 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant: tempest-AttachVolumeTestJSON-1041146077 Aug 09 11:24:41.402492 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Id: 06dd1efa43b043cf84f9808305d97bf0 Aug 09 11:24:41.402492 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1041146077 Aug 09 11:24:41.402492 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User: tempest-AttachVolumeTestJSON-1041146077-project Aug 09 11:24:41.402492 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Id: default Aug 09 11:24:41.402492 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Name: Default Aug 09 11:24:41.402492 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Id: 601782d5743c47f380358021be28cc91 Aug 09 11:24:41.402492 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Name: tempest-AttachVolumeTestJSON-1041146077-project Aug 09 11:24:41.402492 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: method: > Aug 09 11:24:41.402492 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: exception: Instance 6c6b7435-b965-416a-ae82-7eb037cc7152 could not be found. Aug 09 11:24:41.402492 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: action_args: {'id': '6c6b7435-b965-416a-ae82-7eb037cc7152'} Aug 09 11:24:41.403335 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:24:41.403335 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:24:41.403335 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:24:41.403335 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:24:41.403335 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:24:41.403335 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:24:41.403335 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:24:41.403335 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:24:41.403335 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:24:41.403335 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:24:41.403335 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c6b7435-b965-416a-ae82-7eb037cc7152 could not be found. Aug 09 11:24:41.403335 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:41.403335 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:24:41.403335 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:41.403335 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:24:41.403335 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:24:41.403335 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:24:41.403335 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:24:41.403335 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:24:41.403335 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:24:41.405046 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:24:41.405046 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:24:41.405046 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:24:41.405046 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:24:41.405046 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:24:41.405046 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:24:41.405046 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:24:41.405046 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c6b7435-b965-416a-ae82-7eb037cc7152 could not be found. Aug 09 11:24:41.405046 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:41.405046 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:24:41.405046 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:41.405046 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:24:41.405046 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:24:41.405046 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:24:41.405046 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:24:41.405046 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:24:41.405046 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c6b7435-b965-416a-ae82-7eb037cc7152 could not be found. Aug 09 11:24:41.405046 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:41.406574 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-0b5c7d6a-344a-42e0-9f9c-11f4fe6a68bb tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Returning 404 to user: Instance 6c6b7435-b965-416a-ae82-7eb037cc7152 could not be found. {{(pid=117684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:24:41.406574 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-0b5c7d6a-344a-42e0-9f9c-11f4fe6a68bb tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152" status: 404 len: 111 microversion: 2.1 time: 0.031574 Aug 09 11:24:41.406574 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 458/945] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:24:41 2022] GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 11:24:41.414951 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-0d381b95-63ac-464d-a3fd-c7895a7273e9 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '.version_select at 0x7f2821fb0160>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:41.436710 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-0d381b95-63ac-464d-a3fd-c7895a7273e9 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-293088370" status: 202 len: 0 microversion: 2.1 time: 0.025405 Aug 09 11:24:41.437292 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 488/946] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Aug 9 11:24:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-293088370 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:24:42.279313 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-bfbfd9db-0001-4e40-95fd-f0fefaab815f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:42.281529 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-bfbfd9db-0001-4e40-95fd-f0fefaab815f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 92aed47a-39ca-4174-9ae4-b99c2fb029e1] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:42.289388 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-bfbfd9db-0001-4e40-95fd-f0fefaab815f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:42.289871 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-bfbfd9db-0001-4e40-95fd-f0fefaab815f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:42.290296 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-bfbfd9db-0001-4e40-95fd-f0fefaab815f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:42.290992 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-bfbfd9db-0001-4e40-95fd-f0fefaab815f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:42.291468 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-bfbfd9db-0001-4e40-95fd-f0fefaab815f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:42.292102 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-bfbfd9db-0001-4e40-95fd-f0fefaab815f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:42.323239 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-bfbfd9db-0001-4e40-95fd-f0fefaab815f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/92aed47a-39ca-4174-9ae4-b99c2fb029e1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048020 Aug 09 11:24:42.323799 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 459/947] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 9 11:24:42 2022] GET /compute/v2.1/servers/92aed47a-39ca-4174-9ae4-b99c2fb029e1/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 11:24:42.389233 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-f38ddf4d-354a-49d7-89cc-cf767e2f1a89 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:42.389762 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-f38ddf4d-354a-49d7-89cc-cf767e2f1a89 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 92aed47a-39ca-4174-9ae4-b99c2fb029e1] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:42.396503 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f38ddf4d-354a-49d7-89cc-cf767e2f1a89 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:42.396979 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f38ddf4d-354a-49d7-89cc-cf767e2f1a89 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:42.397740 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f38ddf4d-354a-49d7-89cc-cf767e2f1a89 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:42.399277 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f38ddf4d-354a-49d7-89cc-cf767e2f1a89 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:42.400076 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f38ddf4d-354a-49d7-89cc-cf767e2f1a89 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:42.400530 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f38ddf4d-354a-49d7-89cc-cf767e2f1a89 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:42.417843 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-38d3fdcf-f1bd-4e9b-b2a7-17c0d99102c0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:42.418440 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-38d3fdcf-f1bd-4e9b-b2a7-17c0d99102c0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 8009a1a2-4c8e-4953-ba5c-faab2db05078] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:42.424575 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-38d3fdcf-f1bd-4e9b-b2a7-17c0d99102c0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:42.424943 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-38d3fdcf-f1bd-4e9b-b2a7-17c0d99102c0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:42.425370 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-38d3fdcf-f1bd-4e9b-b2a7-17c0d99102c0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:42.426050 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-38d3fdcf-f1bd-4e9b-b2a7-17c0d99102c0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:42.426522 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-38d3fdcf-f1bd-4e9b-b2a7-17c0d99102c0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:42.426935 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-38d3fdcf-f1bd-4e9b-b2a7-17c0d99102c0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:42.430250 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-f38ddf4d-354a-49d7-89cc-cf767e2f1a89 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 92aed47a-39ca-4174-9ae4-b99c2fb029e1] Going to try to terminate instance {{(pid=117685) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 11:24:42.440839 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.wsgi [None req-38d3fdcf-f1bd-4e9b-b2a7-17c0d99102c0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] HTTP exception thrown: Instance 8009a1a2-4c8e-4953-ba5c-faab2db05078 could not be found. Aug 09 11:24:42.442377 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-38d3fdcf-f1bd-4e9b-b2a7-17c0d99102c0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Request method failure captured: Aug 09 11:24:42.442377 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: request: GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 HTTP/1.1 Aug 09 11:24:42.442377 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept: application/json Aug 09 11:24:42.442377 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept-Encoding: identity Aug 09 11:24:42.442377 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Connection: close Aug 09 11:24:42.442377 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Length: 0 Aug 09 11:24:42.442377 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Type: application/json Aug 09 11:24:42.442377 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Host: 10.222.0.27 Aug 09 11:24:42.442377 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Openstack-System-Scope: None Aug 09 11:24:42.442377 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: User-Agent: python-urllib3/1.26.11 Aug 09 11:24:42.442377 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Auth-Token: gAAAAABi8kK4ZURPQKT-E-bhJo1FLIIqaFjoTaLi0t_9gs19mh3N7gqZ6GeAerCuuiTJe0dYAhdQ2iR_bfI_b0ZwFkvbIx4r8Jm4-7nh0tWhT2kBjRkOHrLdvaHoe9ZT_a_-HZxYdn72f859LpQhFNf_Fvg_jqnrIaRWCS_QgEMwXjTJVjY3_8I Aug 09 11:24:42.442377 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Id: None Aug 09 11:24:42.442377 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Name: None Aug 09 11:24:42.442377 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Identity-Status: Confirmed Aug 09 11:24:42.442377 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Is-Admin-Project: True Aug 09 11:24:42.442377 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Id: default Aug 09 11:24:42.442377 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Name: Default Aug 09 11:24:42.442377 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Id: 45bb3a603ddc4d3b8042b6ae687c896e Aug 09 11:24:42.442377 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-338750798 Aug 09 11:24:42.442377 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Role: member,reader Aug 09 11:24:42.442377 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Roles: member,reader Aug 09 11:24:42.443997 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/45bb3a603ddc4d3b8042b6ae687c896e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_45bb3a603ddc4d3b8042b6ae687c896e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/45bb3a603ddc4d3b8042b6ae687c896e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/45bb3a603ddc4d3b8042b6ae687c896e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:24:42.443997 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant: tempest-ServerRescueNegativeTestJSON-338750798 Aug 09 11:24:42.443997 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Id: 45bb3a603ddc4d3b8042b6ae687c896e Aug 09 11:24:42.443997 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-338750798 Aug 09 11:24:42.443997 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User: tempest-ServerRescueNegativeTestJSON-338750798-project Aug 09 11:24:42.443997 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Id: default Aug 09 11:24:42.443997 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Name: Default Aug 09 11:24:42.443997 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Id: 3a1cd35a257f4b0f99141580c14bad48 Aug 09 11:24:42.443997 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Name: tempest-ServerRescueNegativeTestJSON-338750798-project Aug 09 11:24:42.443997 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: method: > Aug 09 11:24:42.443997 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: exception: Instance 8009a1a2-4c8e-4953-ba5c-faab2db05078 could not be found. Aug 09 11:24:42.443997 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: action_args: {'id': '8009a1a2-4c8e-4953-ba5c-faab2db05078'} Aug 09 11:24:42.445150 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:24:42.445150 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:24:42.445150 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:24:42.445150 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:24:42.445150 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:24:42.445150 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:24:42.445150 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:24:42.445150 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:24:42.445150 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:24:42.445150 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:24:42.445150 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8009a1a2-4c8e-4953-ba5c-faab2db05078 could not be found. Aug 09 11:24:42.445150 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:42.445150 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:24:42.445150 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:42.445150 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:24:42.445150 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:24:42.445150 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:24:42.445150 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:24:42.445150 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:24:42.445150 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:24:42.446570 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:24:42.446570 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:24:42.446570 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:24:42.446570 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:24:42.446570 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:24:42.446570 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:24:42.446570 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:24:42.446570 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8009a1a2-4c8e-4953-ba5c-faab2db05078 could not be found. Aug 09 11:24:42.446570 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:42.446570 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:24:42.446570 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:42.446570 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:24:42.446570 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:24:42.446570 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:24:42.446570 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:24:42.446570 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:24:42.446570 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8009a1a2-4c8e-4953-ba5c-faab2db05078 could not be found. Aug 09 11:24:42.446570 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:42.449390 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-38d3fdcf-f1bd-4e9b-b2a7-17c0d99102c0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Returning 404 to user: Instance 8009a1a2-4c8e-4953-ba5c-faab2db05078 could not be found. {{(pid=117684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:24:42.449390 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-38d3fdcf-f1bd-4e9b-b2a7-17c0d99102c0 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078" status: 404 len: 111 microversion: 2.1 time: 0.030051 Aug 09 11:24:42.449390 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 460/948] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:24:42 2022] GET /compute/v2.1/servers/8009a1a2-4c8e-4953-ba5c-faab2db05078 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:24:42.452032 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-66032fc1-de2c-43b7-87ae-f14a236e0400 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '.version_select at 0x7f2821f24af0>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:42.472420 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-66032fc1-de2c-43b7-87ae-f14a236e0400 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1799456783" status: 202 len: 0 microversion: 2.1 time: 0.023838 Aug 09 11:24:42.473003 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 461/949] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Aug 9 11:24:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1799456783 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 11:24:42.513971 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-f38ddf4d-354a-49d7-89cc-cf767e2f1a89 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "DELETE /compute/v2.1/servers/92aed47a-39ca-4174-9ae4-b99c2fb029e1" status: 204 len: 0 microversion: 2.1 time: 0.129457 Aug 09 11:24:42.515012 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 489/950] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 9 11:24:42 2022] DELETE /compute/v2.1/servers/92aed47a-39ca-4174-9ae4-b99c2fb029e1 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 11:24:42.523805 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-c05c7374-278d-4d19-aa46-a90ebef5aa30 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:42.524457 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-c05c7374-278d-4d19-aa46-a90ebef5aa30 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 92aed47a-39ca-4174-9ae4-b99c2fb029e1] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:42.530696 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c05c7374-278d-4d19-aa46-a90ebef5aa30 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:42.531183 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c05c7374-278d-4d19-aa46-a90ebef5aa30 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:42.531668 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c05c7374-278d-4d19-aa46-a90ebef5aa30 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:42.532632 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c05c7374-278d-4d19-aa46-a90ebef5aa30 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:42.533208 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c05c7374-278d-4d19-aa46-a90ebef5aa30 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:42.533644 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c05c7374-278d-4d19-aa46-a90ebef5aa30 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:42.669552 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-c05c7374-278d-4d19-aa46-a90ebef5aa30 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:42.678398 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-c05c7374-278d-4d19-aa46-a90ebef5aa30 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/92aed47a-39ca-4174-9ae4-b99c2fb029e1" status: 200 len: 1683 microversion: 2.1 time: 0.159021 Aug 09 11:24:42.678903 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 462/951] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:24:42 2022] GET /compute/v2.1/servers/92aed47a-39ca-4174-9ae4-b99c2fb029e1 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:24:43.703586 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-079db6bd-28d9-44db-84b2-995de296eb6e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:43.704407 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-079db6bd-28d9-44db-84b2-995de296eb6e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 92aed47a-39ca-4174-9ae4-b99c2fb029e1] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:43.711994 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-079db6bd-28d9-44db-84b2-995de296eb6e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:43.712522 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-079db6bd-28d9-44db-84b2-995de296eb6e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:43.712953 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-079db6bd-28d9-44db-84b2-995de296eb6e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:43.713650 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-079db6bd-28d9-44db-84b2-995de296eb6e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:43.714185 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-079db6bd-28d9-44db-84b2-995de296eb6e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:43.714540 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-079db6bd-28d9-44db-84b2-995de296eb6e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:43.858303 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-079db6bd-28d9-44db-84b2-995de296eb6e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:43.866321 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-079db6bd-28d9-44db-84b2-995de296eb6e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/92aed47a-39ca-4174-9ae4-b99c2fb029e1" status: 200 len: 1683 microversion: 2.1 time: 0.169758 Aug 09 11:24:43.866898 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 490/952] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:24:43 2022] GET /compute/v2.1/servers/92aed47a-39ca-4174-9ae4-b99c2fb029e1 => generated 1683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:24:44.379125 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-19d54f47-3713-4b4e-b345-380cb0639890 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:44.379628 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-19d54f47-3713-4b4e-b345-380cb0639890 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: 6c6b7435-b965-416a-ae82-7eb037cc7152] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:44.386568 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-19d54f47-3713-4b4e-b345-380cb0639890 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:44.387051 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-19d54f47-3713-4b4e-b345-380cb0639890 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:44.387483 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-19d54f47-3713-4b4e-b345-380cb0639890 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:44.388180 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-19d54f47-3713-4b4e-b345-380cb0639890 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:44.388690 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-19d54f47-3713-4b4e-b345-380cb0639890 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:44.389113 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-19d54f47-3713-4b4e-b345-380cb0639890 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:44.403578 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.wsgi [None req-19d54f47-3713-4b4e-b345-380cb0639890 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] HTTP exception thrown: Instance 6c6b7435-b965-416a-ae82-7eb037cc7152 could not be found. Aug 09 11:24:44.405243 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-19d54f47-3713-4b4e-b345-380cb0639890 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Request method failure captured: Aug 09 11:24:44.405243 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: request: DELETE /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152 HTTP/1.1 Aug 09 11:24:44.405243 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept: application/json Aug 09 11:24:44.405243 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept-Encoding: identity Aug 09 11:24:44.405243 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Connection: close Aug 09 11:24:44.405243 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Length: 0 Aug 09 11:24:44.405243 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Type: application/json Aug 09 11:24:44.405243 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Host: 10.222.0.27 Aug 09 11:24:44.405243 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Openstack-System-Scope: None Aug 09 11:24:44.405243 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: User-Agent: python-urllib3/1.26.11 Aug 09 11:24:44.405243 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Auth-Token: gAAAAABi8kJiP2rs-oyULagIWrQ8NK_q4zXCHu9nG4Fnlj5pti_3VSho1aiTw6A41IJOWnMplxYLUKxat19aejWmXOFV77R-MAOlKM-vVw982IRFRnt_0EpXq4kj4KyUHdG5ruXClspZmnaRjeV1WKqLODbLz7uBlJF1UQfZRiYelCeatKLyefE Aug 09 11:24:44.405243 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Id: None Aug 09 11:24:44.405243 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Name: None Aug 09 11:24:44.405243 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Identity-Status: Confirmed Aug 09 11:24:44.405243 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Is-Admin-Project: True Aug 09 11:24:44.405243 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Id: default Aug 09 11:24:44.405243 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Name: Default Aug 09 11:24:44.405243 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Id: 06dd1efa43b043cf84f9808305d97bf0 Aug 09 11:24:44.405243 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Name: tempest-AttachVolumeTestJSON-1041146077 Aug 09 11:24:44.405243 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Role: member,reader Aug 09 11:24:44.405243 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Roles: member,reader Aug 09 11:24:44.406753 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/06dd1efa43b043cf84f9808305d97bf0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_06dd1efa43b043cf84f9808305d97bf0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/06dd1efa43b043cf84f9808305d97bf0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/06dd1efa43b043cf84f9808305d97bf0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:24:44.406753 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant: tempest-AttachVolumeTestJSON-1041146077 Aug 09 11:24:44.406753 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Id: 06dd1efa43b043cf84f9808305d97bf0 Aug 09 11:24:44.406753 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1041146077 Aug 09 11:24:44.406753 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User: tempest-AttachVolumeTestJSON-1041146077-project Aug 09 11:24:44.406753 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Id: default Aug 09 11:24:44.406753 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Name: Default Aug 09 11:24:44.406753 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Id: 601782d5743c47f380358021be28cc91 Aug 09 11:24:44.406753 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Name: tempest-AttachVolumeTestJSON-1041146077-project Aug 09 11:24:44.406753 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: method: > Aug 09 11:24:44.406753 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: exception: Instance 6c6b7435-b965-416a-ae82-7eb037cc7152 could not be found. Aug 09 11:24:44.406753 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: action_args: {'id': '6c6b7435-b965-416a-ae82-7eb037cc7152'} Aug 09 11:24:44.407593 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:24:44.407593 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:24:44.407593 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:24:44.407593 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:24:44.407593 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:24:44.407593 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:24:44.407593 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:24:44.407593 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:24:44.407593 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:24:44.407593 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:24:44.407593 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c6b7435-b965-416a-ae82-7eb037cc7152 could not be found. Aug 09 11:24:44.407593 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:44.407593 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:24:44.407593 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:44.407593 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:24:44.407593 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:24:44.407593 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:24:44.407593 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:24:44.407593 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:24:44.407593 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:24:44.409089 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:24:44.409089 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 11:24:44.409089 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 11:24:44.409089 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 11:24:44.409089 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 11:24:44.409089 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:24:44.409089 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:24:44.409089 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:24:44.409089 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:24:44.409089 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c6b7435-b965-416a-ae82-7eb037cc7152 could not be found. Aug 09 11:24:44.409089 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:44.409089 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:24:44.409089 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:44.409089 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:24:44.409089 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:24:44.409089 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:24:44.409089 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:24:44.409089 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:24:44.409089 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c6b7435-b965-416a-ae82-7eb037cc7152 could not be found. Aug 09 11:24:44.409089 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:44.410632 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-19d54f47-3713-4b4e-b345-380cb0639890 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Returning 404 to user: Instance 6c6b7435-b965-416a-ae82-7eb037cc7152 could not be found. {{(pid=117684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:24:44.410632 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-19d54f47-3713-4b4e-b345-380cb0639890 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152" status: 404 len: 111 microversion: 2.1 time: 0.031585 Aug 09 11:24:44.410632 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 463/953] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 9 11:24:44 2022] DELETE /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:24:44.419258 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-10812a4a-6dbb-4ed9-b930-6a15affc0ef4 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:44.420015 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-10812a4a-6dbb-4ed9-b930-6a15affc0ef4 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: 6c6b7435-b965-416a-ae82-7eb037cc7152] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:44.426434 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-10812a4a-6dbb-4ed9-b930-6a15affc0ef4 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:44.426919 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-10812a4a-6dbb-4ed9-b930-6a15affc0ef4 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:44.427352 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-10812a4a-6dbb-4ed9-b930-6a15affc0ef4 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:44.428028 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-10812a4a-6dbb-4ed9-b930-6a15affc0ef4 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:44.428524 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-10812a4a-6dbb-4ed9-b930-6a15affc0ef4 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:44.428947 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-10812a4a-6dbb-4ed9-b930-6a15affc0ef4 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:44.443067 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.wsgi [None req-10812a4a-6dbb-4ed9-b930-6a15affc0ef4 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] HTTP exception thrown: Instance 6c6b7435-b965-416a-ae82-7eb037cc7152 could not be found. Aug 09 11:24:44.444703 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-10812a4a-6dbb-4ed9-b930-6a15affc0ef4 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Request method failure captured: Aug 09 11:24:44.444703 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: request: GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152 HTTP/1.1 Aug 09 11:24:44.444703 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Accept: application/json Aug 09 11:24:44.444703 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Accept-Encoding: identity Aug 09 11:24:44.444703 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Connection: close Aug 09 11:24:44.444703 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Content-Length: 0 Aug 09 11:24:44.444703 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Content-Type: application/json Aug 09 11:24:44.444703 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Host: 10.222.0.27 Aug 09 11:24:44.444703 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Openstack-System-Scope: None Aug 09 11:24:44.444703 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: User-Agent: python-urllib3/1.26.11 Aug 09 11:24:44.444703 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Auth-Token: gAAAAABi8kJiP2rs-oyULagIWrQ8NK_q4zXCHu9nG4Fnlj5pti_3VSho1aiTw6A41IJOWnMplxYLUKxat19aejWmXOFV77R-MAOlKM-vVw982IRFRnt_0EpXq4kj4KyUHdG5ruXClspZmnaRjeV1WKqLODbLz7uBlJF1UQfZRiYelCeatKLyefE Aug 09 11:24:44.444703 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Domain-Id: None Aug 09 11:24:44.444703 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Domain-Name: None Aug 09 11:24:44.444703 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Identity-Status: Confirmed Aug 09 11:24:44.444703 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Is-Admin-Project: True Aug 09 11:24:44.444703 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Domain-Id: default Aug 09 11:24:44.444703 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Domain-Name: Default Aug 09 11:24:44.444703 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Id: 06dd1efa43b043cf84f9808305d97bf0 Aug 09 11:24:44.444703 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Name: tempest-AttachVolumeTestJSON-1041146077 Aug 09 11:24:44.444703 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Role: member,reader Aug 09 11:24:44.444703 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Roles: member,reader Aug 09 11:24:44.446221 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/06dd1efa43b043cf84f9808305d97bf0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_06dd1efa43b043cf84f9808305d97bf0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/06dd1efa43b043cf84f9808305d97bf0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/06dd1efa43b043cf84f9808305d97bf0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:24:44.446221 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant: tempest-AttachVolumeTestJSON-1041146077 Aug 09 11:24:44.446221 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant-Id: 06dd1efa43b043cf84f9808305d97bf0 Aug 09 11:24:44.446221 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1041146077 Aug 09 11:24:44.446221 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User: tempest-AttachVolumeTestJSON-1041146077-project Aug 09 11:24:44.446221 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Domain-Id: default Aug 09 11:24:44.446221 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Domain-Name: Default Aug 09 11:24:44.446221 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Id: 601782d5743c47f380358021be28cc91 Aug 09 11:24:44.446221 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Name: tempest-AttachVolumeTestJSON-1041146077-project Aug 09 11:24:44.446221 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: method: > Aug 09 11:24:44.446221 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: exception: Instance 6c6b7435-b965-416a-ae82-7eb037cc7152 could not be found. Aug 09 11:24:44.446221 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: action_args: {'id': '6c6b7435-b965-416a-ae82-7eb037cc7152'} Aug 09 11:24:44.447033 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:24:44.447033 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:24:44.447033 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:24:44.447033 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:24:44.447033 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:24:44.447033 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:24:44.447033 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:24:44.447033 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:24:44.447033 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:24:44.447033 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:24:44.447033 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c6b7435-b965-416a-ae82-7eb037cc7152 could not be found. Aug 09 11:24:44.447033 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:24:44.447033 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:24:44.447033 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:24:44.447033 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:24:44.447033 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:24:44.447033 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:24:44.447033 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:24:44.447033 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:24:44.447033 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:24:44.448447 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:24:44.448447 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:24:44.448447 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:24:44.448447 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:24:44.448447 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:24:44.448447 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:24:44.448447 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:24:44.448447 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c6b7435-b965-416a-ae82-7eb037cc7152 could not be found. Aug 09 11:24:44.448447 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:24:44.448447 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:24:44.448447 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:24:44.448447 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:24:44.448447 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:24:44.448447 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:24:44.448447 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:24:44.448447 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:24:44.448447 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c6b7435-b965-416a-ae82-7eb037cc7152 could not be found. Aug 09 11:24:44.448447 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:24:44.450045 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-10812a4a-6dbb-4ed9-b930-6a15affc0ef4 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Returning 404 to user: Instance 6c6b7435-b965-416a-ae82-7eb037cc7152 could not be found. {{(pid=117685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:24:44.450045 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-10812a4a-6dbb-4ed9-b930-6a15affc0ef4 tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152" status: 404 len: 111 microversion: 2.1 time: 0.030831 Aug 09 11:24:44.450045 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 491/954] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:24:44 2022] GET /compute/v2.1/servers/6c6b7435-b965-416a-ae82-7eb037cc7152 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:24:44.889039 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-a8181c02-6fc5-4f5d-bfab-6e73287215d4 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:44.889626 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-a8181c02-6fc5-4f5d-bfab-6e73287215d4 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 92aed47a-39ca-4174-9ae4-b99c2fb029e1] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:44.897978 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a8181c02-6fc5-4f5d-bfab-6e73287215d4 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:44.898469 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a8181c02-6fc5-4f5d-bfab-6e73287215d4 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:44.899308 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a8181c02-6fc5-4f5d-bfab-6e73287215d4 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:44.899655 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a8181c02-6fc5-4f5d-bfab-6e73287215d4 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:44.900110 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a8181c02-6fc5-4f5d-bfab-6e73287215d4 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:44.900533 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a8181c02-6fc5-4f5d-bfab-6e73287215d4 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:44.974755 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-ab0c021e-8d94-4f53-8515-6578b259598d req-85679cbd-ae04-4b61-9317-b10088e00bd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92aed47a-39ca-4174-9ae4-b99c2fb029e1", "name": "network-vif-deleted", "tag": "6e636562-656a-4e4d-8241-b867d69fdc72"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:24:44.988351 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-ab0c021e-8d94-4f53-8515-6578b259598d req-85679cbd-ae04-4b61-9317-b10088e00bd3 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:44.988985 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-ab0c021e-8d94-4f53-8515-6578b259598d req-85679cbd-ae04-4b61-9317-b10088e00bd3 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:44.989574 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-ab0c021e-8d94-4f53-8515-6578b259598d req-85679cbd-ae04-4b61-9317-b10088e00bd3 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:45.001109 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-a8181c02-6fc5-4f5d-bfab-6e73287215d4 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da6dd860bb45d1a703a18c2512ffe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba1dd0b689b4fff847b6fd3787b143c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:45.006218 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell1:SELECT=100 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:24:45.010394 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-ab0c021e-8d94-4f53-8515-6578b259598d req-85679cbd-ae04-4b61-9317-b10088e00bd3 service nova] Creating event network-vif-deleted:6e636562-656a-4e4d-8241-b867d69fdc72 for instance 92aed47a-39ca-4174-9ae4-b99c2fb029e1 on hv-cinder-85251 Aug 09 11:24:45.012983 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-a8181c02-6fc5-4f5d-bfab-6e73287215d4 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/92aed47a-39ca-4174-9ae4-b99c2fb029e1" status: 200 len: 1616 microversion: 2.1 time: 0.127051 Aug 09 11:24:45.014168 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 464/955] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:24:44 2022] GET /compute/v2.1/servers/92aed47a-39ca-4174-9ae4-b99c2fb029e1 => generated 1616 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:24:45.030427 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-ab0c021e-8d94-4f53-8515-6578b259598d req-85679cbd-ae04-4b61-9317-b10088e00bd3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065056 Aug 09 11:24:45.031039 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 492/956] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:24:45.384894 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-72a6b798-5613-4d4e-b25d-35832c6e3614 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:45.385475 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-72a6b798-5613-4d4e-b25d-35832c6e3614 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:45.395172 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-72a6b798-5613-4d4e-b25d-35832c6e3614 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:45.395766 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-72a6b798-5613-4d4e-b25d-35832c6e3614 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:45.396197 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-72a6b798-5613-4d4e-b25d-35832c6e3614 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:45.397889 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-72a6b798-5613-4d4e-b25d-35832c6e3614 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:45.398871 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-72a6b798-5613-4d4e-b25d-35832c6e3614 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:45.399293 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-72a6b798-5613-4d4e-b25d-35832c6e3614 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:45.426663 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-72a6b798-5613-4d4e-b25d-35832c6e3614 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Going to try to terminate instance {{(pid=117684) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 11:24:45.517389 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-72a6b798-5613-4d4e-b25d-35832c6e3614 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "DELETE /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697" status: 204 len: 0 microversion: 2.1 time: 0.138040 Aug 09 11:24:45.518141 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 465/957] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 9 11:24:45 2022] DELETE /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 11:24:45.527781 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-34698430-7926-44ef-b7e4-ec4b5883ad48 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:45.528651 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-34698430-7926-44ef-b7e4-ec4b5883ad48 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:45.535075 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-34698430-7926-44ef-b7e4-ec4b5883ad48 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:45.535560 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-34698430-7926-44ef-b7e4-ec4b5883ad48 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:45.535996 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-34698430-7926-44ef-b7e4-ec4b5883ad48 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:45.536758 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-34698430-7926-44ef-b7e4-ec4b5883ad48 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:45.537209 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-34698430-7926-44ef-b7e4-ec4b5883ad48 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:45.537634 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-34698430-7926-44ef-b7e4-ec4b5883ad48 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:45.597625 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-6abf34f1-9171-4526-9ad3-a231795d86dd tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:45.598144 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-6abf34f1-9171-4526-9ad3-a231795d86dd tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:45.604898 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6abf34f1-9171-4526-9ad3-a231795d86dd tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:45.605704 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6abf34f1-9171-4526-9ad3-a231795d86dd tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:45.606148 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6abf34f1-9171-4526-9ad3-a231795d86dd tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:45.606875 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6abf34f1-9171-4526-9ad3-a231795d86dd tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:45.607331 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6abf34f1-9171-4526-9ad3-a231795d86dd tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:45.607793 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6abf34f1-9171-4526-9ad3-a231795d86dd tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:45.625172 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.wsgi [None req-6abf34f1-9171-4526-9ad3-a231795d86dd tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] HTTP exception thrown: Instance fb805071-5bf8-4c52-9f89-b4bb1272121f could not be found. Aug 09 11:24:45.626895 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-6abf34f1-9171-4526-9ad3-a231795d86dd tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Request method failure captured: Aug 09 11:24:45.626895 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: request: DELETE /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f HTTP/1.1 Aug 09 11:24:45.626895 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept: application/json Aug 09 11:24:45.626895 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept-Encoding: identity Aug 09 11:24:45.626895 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Connection: close Aug 09 11:24:45.626895 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Length: 0 Aug 09 11:24:45.626895 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Type: application/json Aug 09 11:24:45.626895 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Host: 10.222.0.27 Aug 09 11:24:45.626895 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Openstack-System-Scope: None Aug 09 11:24:45.626895 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: User-Agent: python-urllib3/1.26.11 Aug 09 11:24:45.626895 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Auth-Token: gAAAAABi8kJiP2rs-oyULagIWrQ8NK_q4zXCHu9nG4Fnlj5pti_3VSho1aiTw6A41IJOWnMplxYLUKxat19aejWmXOFV77R-MAOlKM-vVw982IRFRnt_0EpXq4kj4KyUHdG5ruXClspZmnaRjeV1WKqLODbLz7uBlJF1UQfZRiYelCeatKLyefE Aug 09 11:24:45.626895 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Id: None Aug 09 11:24:45.626895 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Name: None Aug 09 11:24:45.626895 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Identity-Status: Confirmed Aug 09 11:24:45.626895 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Is-Admin-Project: True Aug 09 11:24:45.626895 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Id: default Aug 09 11:24:45.626895 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Name: Default Aug 09 11:24:45.626895 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Id: 06dd1efa43b043cf84f9808305d97bf0 Aug 09 11:24:45.626895 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Name: tempest-AttachVolumeTestJSON-1041146077 Aug 09 11:24:45.626895 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Role: member,reader Aug 09 11:24:45.626895 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Roles: member,reader Aug 09 11:24:45.628378 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/06dd1efa43b043cf84f9808305d97bf0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_06dd1efa43b043cf84f9808305d97bf0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/06dd1efa43b043cf84f9808305d97bf0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/06dd1efa43b043cf84f9808305d97bf0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:24:45.628378 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant: tempest-AttachVolumeTestJSON-1041146077 Aug 09 11:24:45.628378 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Id: 06dd1efa43b043cf84f9808305d97bf0 Aug 09 11:24:45.628378 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1041146077 Aug 09 11:24:45.628378 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User: tempest-AttachVolumeTestJSON-1041146077-project Aug 09 11:24:45.628378 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Id: default Aug 09 11:24:45.628378 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Name: Default Aug 09 11:24:45.628378 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Id: 601782d5743c47f380358021be28cc91 Aug 09 11:24:45.628378 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Name: tempest-AttachVolumeTestJSON-1041146077-project Aug 09 11:24:45.628378 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: method: > Aug 09 11:24:45.628378 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: exception: Instance fb805071-5bf8-4c52-9f89-b4bb1272121f could not be found. Aug 09 11:24:45.628378 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: action_args: {'id': 'fb805071-5bf8-4c52-9f89-b4bb1272121f'} Aug 09 11:24:45.629332 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:24:45.629332 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:24:45.629332 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:24:45.629332 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:24:45.629332 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:24:45.629332 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:24:45.629332 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:24:45.629332 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:24:45.629332 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:24:45.629332 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:24:45.629332 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb805071-5bf8-4c52-9f89-b4bb1272121f could not be found. Aug 09 11:24:45.629332 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:45.629332 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:24:45.629332 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:45.629332 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:24:45.629332 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:24:45.629332 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:24:45.629332 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:24:45.629332 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:24:45.629332 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:24:45.630556 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:24:45.630556 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 11:24:45.630556 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 11:24:45.630556 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 11:24:45.630556 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 11:24:45.630556 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:24:45.630556 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:24:45.630556 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:24:45.630556 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:24:45.630556 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb805071-5bf8-4c52-9f89-b4bb1272121f could not be found. Aug 09 11:24:45.630556 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:45.630556 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:24:45.630556 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:45.630556 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:24:45.630556 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:24:45.630556 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:24:45.630556 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:24:45.630556 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:24:45.630556 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb805071-5bf8-4c52-9f89-b4bb1272121f could not be found. Aug 09 11:24:45.630556 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:45.631802 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-6abf34f1-9171-4526-9ad3-a231795d86dd tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Returning 404 to user: Instance fb805071-5bf8-4c52-9f89-b4bb1272121f could not be found. {{(pid=117684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:24:45.631802 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-6abf34f1-9171-4526-9ad3-a231795d86dd tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 404 len: 111 microversion: 2.1 time: 0.035371 Aug 09 11:24:45.632346 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 466/958] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 9 11:24:45 2022] DELETE /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:24:45.637176 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-306bb7be-88ca-4285-ada5-4d85f4f1dc3f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:45.637795 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-306bb7be-88ca-4285-ada5-4d85f4f1dc3f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] [instance: fb805071-5bf8-4c52-9f89-b4bb1272121f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:45.644232 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-306bb7be-88ca-4285-ada5-4d85f4f1dc3f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:45.644772 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-306bb7be-88ca-4285-ada5-4d85f4f1dc3f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:45.645213 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-306bb7be-88ca-4285-ada5-4d85f4f1dc3f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:45.645924 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-306bb7be-88ca-4285-ada5-4d85f4f1dc3f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:45.646376 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-306bb7be-88ca-4285-ada5-4d85f4f1dc3f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:45.646799 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-306bb7be-88ca-4285-ada5-4d85f4f1dc3f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:45.661903 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.wsgi [None req-306bb7be-88ca-4285-ada5-4d85f4f1dc3f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] HTTP exception thrown: Instance fb805071-5bf8-4c52-9f89-b4bb1272121f could not be found. Aug 09 11:24:45.663473 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-306bb7be-88ca-4285-ada5-4d85f4f1dc3f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Request method failure captured: Aug 09 11:24:45.663473 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: request: GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f HTTP/1.1 Aug 09 11:24:45.663473 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept: application/json Aug 09 11:24:45.663473 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept-Encoding: identity Aug 09 11:24:45.663473 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Connection: close Aug 09 11:24:45.663473 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Length: 0 Aug 09 11:24:45.663473 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Type: application/json Aug 09 11:24:45.663473 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Host: 10.222.0.27 Aug 09 11:24:45.663473 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Openstack-System-Scope: None Aug 09 11:24:45.663473 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: User-Agent: python-urllib3/1.26.11 Aug 09 11:24:45.663473 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Auth-Token: gAAAAABi8kJiP2rs-oyULagIWrQ8NK_q4zXCHu9nG4Fnlj5pti_3VSho1aiTw6A41IJOWnMplxYLUKxat19aejWmXOFV77R-MAOlKM-vVw982IRFRnt_0EpXq4kj4KyUHdG5ruXClspZmnaRjeV1WKqLODbLz7uBlJF1UQfZRiYelCeatKLyefE Aug 09 11:24:45.663473 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Id: None Aug 09 11:24:45.663473 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Name: None Aug 09 11:24:45.663473 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Identity-Status: Confirmed Aug 09 11:24:45.663473 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Is-Admin-Project: True Aug 09 11:24:45.663473 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Id: default Aug 09 11:24:45.663473 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Name: Default Aug 09 11:24:45.663473 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Id: 06dd1efa43b043cf84f9808305d97bf0 Aug 09 11:24:45.663473 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Name: tempest-AttachVolumeTestJSON-1041146077 Aug 09 11:24:45.663473 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Role: member,reader Aug 09 11:24:45.663473 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Roles: member,reader Aug 09 11:24:45.665009 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/06dd1efa43b043cf84f9808305d97bf0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_06dd1efa43b043cf84f9808305d97bf0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/06dd1efa43b043cf84f9808305d97bf0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/06dd1efa43b043cf84f9808305d97bf0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:24:45.665009 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant: tempest-AttachVolumeTestJSON-1041146077 Aug 09 11:24:45.665009 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Id: 06dd1efa43b043cf84f9808305d97bf0 Aug 09 11:24:45.665009 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1041146077 Aug 09 11:24:45.665009 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User: tempest-AttachVolumeTestJSON-1041146077-project Aug 09 11:24:45.665009 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Id: default Aug 09 11:24:45.665009 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Name: Default Aug 09 11:24:45.665009 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Id: 601782d5743c47f380358021be28cc91 Aug 09 11:24:45.665009 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Name: tempest-AttachVolumeTestJSON-1041146077-project Aug 09 11:24:45.665009 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: method: > Aug 09 11:24:45.665009 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: exception: Instance fb805071-5bf8-4c52-9f89-b4bb1272121f could not be found. Aug 09 11:24:45.665009 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: action_args: {'id': 'fb805071-5bf8-4c52-9f89-b4bb1272121f'} Aug 09 11:24:45.665726 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:24:45.665726 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:24:45.665726 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:24:45.665726 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:24:45.665726 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:24:45.665726 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:24:45.665726 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:24:45.665726 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:24:45.665726 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:24:45.665726 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:24:45.665726 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb805071-5bf8-4c52-9f89-b4bb1272121f could not be found. Aug 09 11:24:45.665726 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:45.665726 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:24:45.665726 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:45.665726 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:24:45.665726 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:24:45.665726 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:24:45.665726 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:24:45.665726 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:24:45.665726 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:24:45.666930 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:24:45.666930 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:24:45.666930 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:24:45.666930 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:24:45.666930 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:24:45.666930 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:24:45.666930 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:24:45.666930 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb805071-5bf8-4c52-9f89-b4bb1272121f could not be found. Aug 09 11:24:45.666930 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:45.666930 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:24:45.666930 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:45.666930 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:24:45.666930 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:24:45.666930 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:24:45.666930 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:24:45.666930 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:24:45.666930 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb805071-5bf8-4c52-9f89-b4bb1272121f could not be found. Aug 09 11:24:45.666930 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:45.668008 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-306bb7be-88ca-4285-ada5-4d85f4f1dc3f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] Returning 404 to user: Instance fb805071-5bf8-4c52-9f89-b4bb1272121f could not be found. {{(pid=117684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:24:45.668008 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-306bb7be-88ca-4285-ada5-4d85f4f1dc3f tempest-AttachVolumeTestJSON-1041146077 tempest-AttachVolumeTestJSON-1041146077-project] 10.222.0.27 "GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f" status: 404 len: 111 microversion: 2.1 time: 0.031701 Aug 09 11:24:45.668008 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 467/959] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:24:45 2022] GET /compute/v2.1/servers/fb805071-5bf8-4c52-9f89-b4bb1272121f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:24:45.699991 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-34698430-7926-44ef-b7e4-ec4b5883ad48 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:45.708937 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-34698430-7926-44ef-b7e4-ec4b5883ad48 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697" status: 200 len: 1507 microversion: 2.1 time: 0.185570 Aug 09 11:24:45.709532 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 493/960] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:24:45 2022] GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697 => generated 1507 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:24:46.035174 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-47ab0e91-b1bf-4eb8-9e81-1de2908e33fb tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:46.035907 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-47ab0e91-b1bf-4eb8-9e81-1de2908e33fb tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 92aed47a-39ca-4174-9ae4-b99c2fb029e1] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:46.043877 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-47ab0e91-b1bf-4eb8-9e81-1de2908e33fb tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:46.044507 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-47ab0e91-b1bf-4eb8-9e81-1de2908e33fb tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:46.044953 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-47ab0e91-b1bf-4eb8-9e81-1de2908e33fb tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:46.045786 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-47ab0e91-b1bf-4eb8-9e81-1de2908e33fb tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:46.046311 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-47ab0e91-b1bf-4eb8-9e81-1de2908e33fb tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:46.046747 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-47ab0e91-b1bf-4eb8-9e81-1de2908e33fb tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:46.062720 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.wsgi [None req-47ab0e91-b1bf-4eb8-9e81-1de2908e33fb tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] HTTP exception thrown: Instance 92aed47a-39ca-4174-9ae4-b99c2fb029e1 could not be found. Aug 09 11:24:46.064226 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-47ab0e91-b1bf-4eb8-9e81-1de2908e33fb tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Request method failure captured: Aug 09 11:24:46.064226 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: request: GET /compute/v2.1/servers/92aed47a-39ca-4174-9ae4-b99c2fb029e1 HTTP/1.1 Aug 09 11:24:46.064226 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept: application/json Aug 09 11:24:46.064226 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept-Encoding: identity Aug 09 11:24:46.064226 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Connection: close Aug 09 11:24:46.064226 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Length: 0 Aug 09 11:24:46.064226 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Type: application/json Aug 09 11:24:46.064226 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Host: 10.222.0.27 Aug 09 11:24:46.064226 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Openstack-System-Scope: None Aug 09 11:24:46.064226 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: User-Agent: python-urllib3/1.26.11 Aug 09 11:24:46.064226 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Auth-Token: gAAAAABi8kJrkCuZ0ZtlZIUmAC-EK2I0okp8exzRXbUBoHrpFGaG17TfS3kn4sSvkBzyMOMoCBQBmvOs9UrhF5xw2U46aP5Pxlq5Kj8piUuPsDzn7s8ETM_3P18gyColYBDIhcjSMUGohuoeVN3S8QIKYIofZURyiH1QY4Vi6NWdxWuymPkih0k Aug 09 11:24:46.064226 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Id: None Aug 09 11:24:46.064226 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Name: None Aug 09 11:24:46.064226 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Identity-Status: Confirmed Aug 09 11:24:46.064226 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Is-Admin-Project: True Aug 09 11:24:46.064226 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Id: default Aug 09 11:24:46.064226 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Name: Default Aug 09 11:24:46.064226 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Id: cba1dd0b689b4fff847b6fd3787b143c Aug 09 11:24:46.064226 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Name: tempest-AttachVolumeNegativeTest-1410930012 Aug 09 11:24:46.064226 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Role: member,reader Aug 09 11:24:46.064226 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Roles: member,reader Aug 09 11:24:46.065574 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:24:46.065574 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant: tempest-AttachVolumeNegativeTest-1410930012 Aug 09 11:24:46.065574 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Id: cba1dd0b689b4fff847b6fd3787b143c Aug 09 11:24:46.065574 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1410930012 Aug 09 11:24:46.065574 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User: tempest-AttachVolumeNegativeTest-1410930012-project Aug 09 11:24:46.065574 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Id: default Aug 09 11:24:46.065574 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Name: Default Aug 09 11:24:46.065574 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Id: f4da6dd860bb45d1a703a18c2512ffe4 Aug 09 11:24:46.065574 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Name: tempest-AttachVolumeNegativeTest-1410930012-project Aug 09 11:24:46.065574 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: method: > Aug 09 11:24:46.065574 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: exception: Instance 92aed47a-39ca-4174-9ae4-b99c2fb029e1 could not be found. Aug 09 11:24:46.065574 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: action_args: {'id': '92aed47a-39ca-4174-9ae4-b99c2fb029e1'} Aug 09 11:24:46.066533 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:24:46.066533 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:24:46.066533 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:24:46.066533 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:24:46.066533 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:24:46.066533 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:24:46.066533 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:24:46.066533 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:24:46.066533 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:24:46.066533 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:24:46.066533 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92aed47a-39ca-4174-9ae4-b99c2fb029e1 could not be found. Aug 09 11:24:46.066533 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:46.066533 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:24:46.066533 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:46.066533 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:24:46.066533 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:24:46.066533 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:24:46.066533 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:24:46.066533 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:24:46.066533 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:24:46.067789 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:24:46.067789 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:24:46.067789 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:24:46.067789 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:24:46.067789 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:24:46.067789 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:24:46.067789 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:24:46.067789 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92aed47a-39ca-4174-9ae4-b99c2fb029e1 could not be found. Aug 09 11:24:46.067789 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:46.067789 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:24:46.067789 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:46.067789 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:24:46.067789 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:24:46.067789 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:24:46.067789 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:24:46.067789 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:24:46.067789 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92aed47a-39ca-4174-9ae4-b99c2fb029e1 could not be found. Aug 09 11:24:46.067789 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:46.069211 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-47ab0e91-b1bf-4eb8-9e81-1de2908e33fb tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Returning 404 to user: Instance 92aed47a-39ca-4174-9ae4-b99c2fb029e1 could not be found. {{(pid=117684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:24:46.069211 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-47ab0e91-b1bf-4eb8-9e81-1de2908e33fb tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/92aed47a-39ca-4174-9ae4-b99c2fb029e1" status: 404 len: 111 microversion: 2.1 time: 0.034681 Aug 09 11:24:46.069211 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 468/961] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:24:46 2022] GET /compute/v2.1/servers/92aed47a-39ca-4174-9ae4-b99c2fb029e1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:24:46.075285 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-ded6f0e3-7920-4c76-b591-309adb196650 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '.version_select at 0x7f282202b5e0>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:46.095750 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-ded6f0e3-7920-4c76-b591-309adb196650 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2004963148" status: 202 len: 0 microversion: 2.1 time: 0.024369 Aug 09 11:24:46.096376 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 494/962] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Aug 9 11:24:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2004963148 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 11:24:46.730912 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-99225aea-9687-46c3-852f-c1e3c52f3772 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:46.731630 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-99225aea-9687-46c3-852f-c1e3c52f3772 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:46.739211 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-99225aea-9687-46c3-852f-c1e3c52f3772 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:46.739770 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-99225aea-9687-46c3-852f-c1e3c52f3772 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:46.740298 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-99225aea-9687-46c3-852f-c1e3c52f3772 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:46.741083 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-99225aea-9687-46c3-852f-c1e3c52f3772 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:46.741598 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-99225aea-9687-46c3-852f-c1e3c52f3772 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:46.742101 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-99225aea-9687-46c3-852f-c1e3c52f3772 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:46.982317 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-99225aea-9687-46c3-852f-c1e3c52f3772 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:46.996662 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-99225aea-9687-46c3-852f-c1e3c52f3772 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697" status: 200 len: 1507 microversion: 2.1 time: 0.269837 Aug 09 11:24:46.997480 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 469/963] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:24:46 2022] GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697 => generated 1507 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:24:47.352983 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-fa9d7bb2-cb1e-4f2f-be53-0d4b79206bf6 req-806d2dd6-526b-47fd-851d-3a317e59c5c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adaae31d-051b-44d0-b6a7-ac5e3aa15697", "name": "network-vif-deleted", "tag": "8f3b07d6-b63e-4e36-8e6f-5b71de7a9b5f"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:24:47.365304 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-fa9d7bb2-cb1e-4f2f-be53-0d4b79206bf6 req-806d2dd6-526b-47fd-851d-3a317e59c5c3 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:47.365874 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-fa9d7bb2-cb1e-4f2f-be53-0d4b79206bf6 req-806d2dd6-526b-47fd-851d-3a317e59c5c3 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:47.366292 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-fa9d7bb2-cb1e-4f2f-be53-0d4b79206bf6 req-806d2dd6-526b-47fd-851d-3a317e59c5c3 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:47.378769 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-fa9d7bb2-cb1e-4f2f-be53-0d4b79206bf6 req-806d2dd6-526b-47fd-851d-3a317e59c5c3 service nova] Creating event network-vif-deleted:8f3b07d6-b63e-4e36-8e6f-5b71de7a9b5f for instance adaae31d-051b-44d0-b6a7-ac5e3aa15697 on hv-cinder-85251 Aug 09 11:24:47.385304 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-fa9d7bb2-cb1e-4f2f-be53-0d4b79206bf6 req-806d2dd6-526b-47fd-851d-3a317e59c5c3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036133 Aug 09 11:24:47.385914 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 495/964] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:24:47.888057 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-760f05aa-db3b-4853-9b6b-37cdb5dadf8f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:47.889269 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-760f05aa-db3b-4853-9b6b-37cdb5dadf8f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 92aed47a-39ca-4174-9ae4-b99c2fb029e1] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:47.913261 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-760f05aa-db3b-4853-9b6b-37cdb5dadf8f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:47.913871 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-760f05aa-db3b-4853-9b6b-37cdb5dadf8f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:47.914558 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-760f05aa-db3b-4853-9b6b-37cdb5dadf8f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:47.916119 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-760f05aa-db3b-4853-9b6b-37cdb5dadf8f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:47.916689 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-760f05aa-db3b-4853-9b6b-37cdb5dadf8f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:47.917145 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-760f05aa-db3b-4853-9b6b-37cdb5dadf8f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:47.932767 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.wsgi [None req-760f05aa-db3b-4853-9b6b-37cdb5dadf8f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] HTTP exception thrown: Instance 92aed47a-39ca-4174-9ae4-b99c2fb029e1 could not be found. Aug 09 11:24:47.934580 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-760f05aa-db3b-4853-9b6b-37cdb5dadf8f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Request method failure captured: Aug 09 11:24:47.934580 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: request: DELETE /compute/v2.1/servers/92aed47a-39ca-4174-9ae4-b99c2fb029e1 HTTP/1.1 Aug 09 11:24:47.934580 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept: application/json Aug 09 11:24:47.934580 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept-Encoding: identity Aug 09 11:24:47.934580 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Connection: close Aug 09 11:24:47.934580 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Length: 0 Aug 09 11:24:47.934580 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Type: application/json Aug 09 11:24:47.934580 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Host: 10.222.0.27 Aug 09 11:24:47.934580 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Openstack-System-Scope: None Aug 09 11:24:47.934580 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: User-Agent: python-urllib3/1.26.11 Aug 09 11:24:47.934580 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Auth-Token: gAAAAABi8kJrkCuZ0ZtlZIUmAC-EK2I0okp8exzRXbUBoHrpFGaG17TfS3kn4sSvkBzyMOMoCBQBmvOs9UrhF5xw2U46aP5Pxlq5Kj8piUuPsDzn7s8ETM_3P18gyColYBDIhcjSMUGohuoeVN3S8QIKYIofZURyiH1QY4Vi6NWdxWuymPkih0k Aug 09 11:24:47.934580 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Id: None Aug 09 11:24:47.934580 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Name: None Aug 09 11:24:47.934580 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Identity-Status: Confirmed Aug 09 11:24:47.934580 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Is-Admin-Project: True Aug 09 11:24:47.934580 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Id: default Aug 09 11:24:47.934580 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Name: Default Aug 09 11:24:47.934580 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Id: cba1dd0b689b4fff847b6fd3787b143c Aug 09 11:24:47.934580 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Name: tempest-AttachVolumeNegativeTest-1410930012 Aug 09 11:24:47.934580 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Role: member,reader Aug 09 11:24:47.934580 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Roles: member,reader Aug 09 11:24:47.936018 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:24:47.936018 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant: tempest-AttachVolumeNegativeTest-1410930012 Aug 09 11:24:47.936018 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Id: cba1dd0b689b4fff847b6fd3787b143c Aug 09 11:24:47.936018 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1410930012 Aug 09 11:24:47.936018 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User: tempest-AttachVolumeNegativeTest-1410930012-project Aug 09 11:24:47.936018 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Id: default Aug 09 11:24:47.936018 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Name: Default Aug 09 11:24:47.936018 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Id: f4da6dd860bb45d1a703a18c2512ffe4 Aug 09 11:24:47.936018 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Name: tempest-AttachVolumeNegativeTest-1410930012-project Aug 09 11:24:47.936018 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: method: > Aug 09 11:24:47.936018 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: exception: Instance 92aed47a-39ca-4174-9ae4-b99c2fb029e1 could not be found. Aug 09 11:24:47.936018 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: action_args: {'id': '92aed47a-39ca-4174-9ae4-b99c2fb029e1'} Aug 09 11:24:47.936846 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:24:47.936846 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:24:47.936846 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:24:47.936846 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:24:47.936846 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:24:47.936846 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:24:47.936846 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:24:47.936846 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:24:47.936846 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:24:47.936846 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:24:47.936846 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92aed47a-39ca-4174-9ae4-b99c2fb029e1 could not be found. Aug 09 11:24:47.936846 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:47.936846 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:24:47.936846 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:47.936846 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:24:47.936846 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:24:47.936846 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:24:47.936846 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:24:47.936846 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:24:47.936846 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:24:47.938588 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:24:47.938588 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 11:24:47.938588 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 11:24:47.938588 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 11:24:47.938588 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 11:24:47.938588 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:24:47.938588 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:24:47.938588 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:24:47.938588 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:24:47.938588 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92aed47a-39ca-4174-9ae4-b99c2fb029e1 could not be found. Aug 09 11:24:47.938588 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:47.938588 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:24:47.938588 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:47.938588 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:24:47.938588 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:24:47.938588 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:24:47.938588 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:24:47.938588 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:24:47.938588 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92aed47a-39ca-4174-9ae4-b99c2fb029e1 could not be found. Aug 09 11:24:47.938588 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:47.941001 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-760f05aa-db3b-4853-9b6b-37cdb5dadf8f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Returning 404 to user: Instance 92aed47a-39ca-4174-9ae4-b99c2fb029e1 could not be found. {{(pid=117684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:24:47.941001 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-760f05aa-db3b-4853-9b6b-37cdb5dadf8f tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "DELETE /compute/v2.1/servers/92aed47a-39ca-4174-9ae4-b99c2fb029e1" status: 404 len: 111 microversion: 2.1 time: 0.053122 Aug 09 11:24:47.941001 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 470/965] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 9 11:24:47 2022] DELETE /compute/v2.1/servers/92aed47a-39ca-4174-9ae4-b99c2fb029e1 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:24:47.946891 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-43668c7b-2bd1-4efa-89e9-13d4187453c3 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:47.947581 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-43668c7b-2bd1-4efa-89e9-13d4187453c3 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 92aed47a-39ca-4174-9ae4-b99c2fb029e1] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:47.953966 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-43668c7b-2bd1-4efa-89e9-13d4187453c3 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:47.954442 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-43668c7b-2bd1-4efa-89e9-13d4187453c3 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:47.954863 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-43668c7b-2bd1-4efa-89e9-13d4187453c3 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:47.955542 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-43668c7b-2bd1-4efa-89e9-13d4187453c3 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:47.956071 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-43668c7b-2bd1-4efa-89e9-13d4187453c3 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:47.956650 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-43668c7b-2bd1-4efa-89e9-13d4187453c3 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:47.970792 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.wsgi [None req-43668c7b-2bd1-4efa-89e9-13d4187453c3 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] HTTP exception thrown: Instance 92aed47a-39ca-4174-9ae4-b99c2fb029e1 could not be found. Aug 09 11:24:47.972826 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-43668c7b-2bd1-4efa-89e9-13d4187453c3 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Request method failure captured: Aug 09 11:24:47.972826 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: request: GET /compute/v2.1/servers/92aed47a-39ca-4174-9ae4-b99c2fb029e1 HTTP/1.1 Aug 09 11:24:47.972826 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Accept: application/json Aug 09 11:24:47.972826 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Accept-Encoding: identity Aug 09 11:24:47.972826 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Connection: close Aug 09 11:24:47.972826 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Content-Length: 0 Aug 09 11:24:47.972826 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Content-Type: application/json Aug 09 11:24:47.972826 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Host: 10.222.0.27 Aug 09 11:24:47.972826 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Openstack-System-Scope: None Aug 09 11:24:47.972826 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: User-Agent: python-urllib3/1.26.11 Aug 09 11:24:47.972826 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Auth-Token: gAAAAABi8kJrkCuZ0ZtlZIUmAC-EK2I0okp8exzRXbUBoHrpFGaG17TfS3kn4sSvkBzyMOMoCBQBmvOs9UrhF5xw2U46aP5Pxlq5Kj8piUuPsDzn7s8ETM_3P18gyColYBDIhcjSMUGohuoeVN3S8QIKYIofZURyiH1QY4Vi6NWdxWuymPkih0k Aug 09 11:24:47.972826 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Domain-Id: None Aug 09 11:24:47.972826 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Domain-Name: None Aug 09 11:24:47.972826 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Identity-Status: Confirmed Aug 09 11:24:47.972826 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Is-Admin-Project: True Aug 09 11:24:47.972826 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Domain-Id: default Aug 09 11:24:47.972826 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Domain-Name: Default Aug 09 11:24:47.972826 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Id: cba1dd0b689b4fff847b6fd3787b143c Aug 09 11:24:47.972826 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Name: tempest-AttachVolumeNegativeTest-1410930012 Aug 09 11:24:47.972826 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Role: member,reader Aug 09 11:24:47.972826 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Roles: member,reader Aug 09 11:24:47.974167 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:24:47.974167 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant: tempest-AttachVolumeNegativeTest-1410930012 Aug 09 11:24:47.974167 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant-Id: cba1dd0b689b4fff847b6fd3787b143c Aug 09 11:24:47.974167 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1410930012 Aug 09 11:24:47.974167 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User: tempest-AttachVolumeNegativeTest-1410930012-project Aug 09 11:24:47.974167 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Domain-Id: default Aug 09 11:24:47.974167 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Domain-Name: Default Aug 09 11:24:47.974167 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Id: f4da6dd860bb45d1a703a18c2512ffe4 Aug 09 11:24:47.974167 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Name: tempest-AttachVolumeNegativeTest-1410930012-project Aug 09 11:24:47.974167 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: method: > Aug 09 11:24:47.974167 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: exception: Instance 92aed47a-39ca-4174-9ae4-b99c2fb029e1 could not be found. Aug 09 11:24:47.974167 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: action_args: {'id': '92aed47a-39ca-4174-9ae4-b99c2fb029e1'} Aug 09 11:24:47.975054 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:24:47.975054 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:24:47.975054 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:24:47.975054 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:24:47.975054 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:24:47.975054 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:24:47.975054 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:24:47.975054 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:24:47.975054 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:24:47.975054 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:24:47.975054 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92aed47a-39ca-4174-9ae4-b99c2fb029e1 could not be found. Aug 09 11:24:47.975054 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:24:47.975054 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:24:47.975054 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:24:47.975054 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:24:47.975054 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:24:47.975054 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:24:47.975054 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:24:47.975054 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:24:47.975054 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:24:47.977938 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:24:47.977938 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:24:47.977938 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:24:47.977938 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:24:47.977938 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:24:47.977938 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:24:47.977938 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:24:47.977938 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92aed47a-39ca-4174-9ae4-b99c2fb029e1 could not be found. Aug 09 11:24:47.977938 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:24:47.977938 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:24:47.977938 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:24:47.977938 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:24:47.977938 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:24:47.977938 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:24:47.977938 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:24:47.977938 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:24:47.977938 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92aed47a-39ca-4174-9ae4-b99c2fb029e1 could not be found. Aug 09 11:24:47.977938 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:24:47.979248 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-43668c7b-2bd1-4efa-89e9-13d4187453c3 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Returning 404 to user: Instance 92aed47a-39ca-4174-9ae4-b99c2fb029e1 could not be found. {{(pid=117685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:24:47.979248 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-43668c7b-2bd1-4efa-89e9-13d4187453c3 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/92aed47a-39ca-4174-9ae4-b99c2fb029e1" status: 404 len: 111 microversion: 2.1 time: 0.031933 Aug 09 11:24:47.979248 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 496/966] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:24:47 2022] GET /compute/v2.1/servers/92aed47a-39ca-4174-9ae4-b99c2fb029e1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:24:48.021918 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-0b7bd62c-5f5c-4c0d-9462-acd308a7f5cf tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:48.022894 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-0b7bd62c-5f5c-4c0d-9462-acd308a7f5cf tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: adaae31d-051b-44d0-b6a7-ac5e3aa15697] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:48.029300 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0b7bd62c-5f5c-4c0d-9462-acd308a7f5cf tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:48.029941 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0b7bd62c-5f5c-4c0d-9462-acd308a7f5cf tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:48.030372 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0b7bd62c-5f5c-4c0d-9462-acd308a7f5cf tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:48.031084 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0b7bd62c-5f5c-4c0d-9462-acd308a7f5cf tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:48.031549 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0b7bd62c-5f5c-4c0d-9462-acd308a7f5cf tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:48.032187 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0b7bd62c-5f5c-4c0d-9462-acd308a7f5cf tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:48.055324 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.wsgi [None req-0b7bd62c-5f5c-4c0d-9462-acd308a7f5cf tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] HTTP exception thrown: Instance adaae31d-051b-44d0-b6a7-ac5e3aa15697 could not be found. Aug 09 11:24:48.057570 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-0b7bd62c-5f5c-4c0d-9462-acd308a7f5cf tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Request method failure captured: Aug 09 11:24:48.057570 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: request: GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697 HTTP/1.1 Aug 09 11:24:48.057570 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept: application/json Aug 09 11:24:48.057570 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept-Encoding: identity Aug 09 11:24:48.057570 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Connection: close Aug 09 11:24:48.057570 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Length: 0 Aug 09 11:24:48.057570 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Type: application/json Aug 09 11:24:48.057570 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Host: 10.222.0.27 Aug 09 11:24:48.057570 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Openstack-System-Scope: None Aug 09 11:24:48.057570 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: User-Agent: python-urllib3/1.26.11 Aug 09 11:24:48.057570 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Auth-Token: gAAAAABi8kK4ZURPQKT-E-bhJo1FLIIqaFjoTaLi0t_9gs19mh3N7gqZ6GeAerCuuiTJe0dYAhdQ2iR_bfI_b0ZwFkvbIx4r8Jm4-7nh0tWhT2kBjRkOHrLdvaHoe9ZT_a_-HZxYdn72f859LpQhFNf_Fvg_jqnrIaRWCS_QgEMwXjTJVjY3_8I Aug 09 11:24:48.057570 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Id: None Aug 09 11:24:48.057570 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Name: None Aug 09 11:24:48.057570 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Identity-Status: Confirmed Aug 09 11:24:48.057570 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Is-Admin-Project: True Aug 09 11:24:48.057570 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Id: default Aug 09 11:24:48.057570 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Name: Default Aug 09 11:24:48.057570 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Id: 45bb3a603ddc4d3b8042b6ae687c896e Aug 09 11:24:48.057570 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-338750798 Aug 09 11:24:48.057570 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Role: member,reader Aug 09 11:24:48.057570 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Roles: member,reader Aug 09 11:24:48.059152 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/45bb3a603ddc4d3b8042b6ae687c896e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_45bb3a603ddc4d3b8042b6ae687c896e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/45bb3a603ddc4d3b8042b6ae687c896e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/45bb3a603ddc4d3b8042b6ae687c896e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:24:48.059152 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant: tempest-ServerRescueNegativeTestJSON-338750798 Aug 09 11:24:48.059152 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Id: 45bb3a603ddc4d3b8042b6ae687c896e Aug 09 11:24:48.059152 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-338750798 Aug 09 11:24:48.059152 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User: tempest-ServerRescueNegativeTestJSON-338750798-project Aug 09 11:24:48.059152 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Id: default Aug 09 11:24:48.059152 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Name: Default Aug 09 11:24:48.059152 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Id: 3a1cd35a257f4b0f99141580c14bad48 Aug 09 11:24:48.059152 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Name: tempest-ServerRescueNegativeTestJSON-338750798-project Aug 09 11:24:48.059152 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: method: > Aug 09 11:24:48.059152 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: exception: Instance adaae31d-051b-44d0-b6a7-ac5e3aa15697 could not be found. Aug 09 11:24:48.059152 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: action_args: {'id': 'adaae31d-051b-44d0-b6a7-ac5e3aa15697'} Aug 09 11:24:48.060392 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:24:48.060392 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:24:48.060392 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:24:48.060392 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:24:48.060392 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:24:48.060392 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:24:48.060392 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:24:48.060392 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:24:48.060392 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:24:48.060392 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:24:48.060392 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adaae31d-051b-44d0-b6a7-ac5e3aa15697 could not be found. Aug 09 11:24:48.060392 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:48.060392 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:24:48.060392 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:48.060392 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:24:48.060392 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:24:48.060392 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:24:48.060392 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:24:48.060392 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:24:48.060392 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:24:48.061913 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:24:48.061913 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:24:48.061913 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:24:48.061913 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:24:48.061913 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:24:48.061913 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:24:48.061913 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:24:48.061913 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adaae31d-051b-44d0-b6a7-ac5e3aa15697 could not be found. Aug 09 11:24:48.061913 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:48.061913 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:24:48.061913 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:48.061913 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:24:48.061913 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:24:48.061913 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:24:48.061913 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:24:48.061913 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:24:48.061913 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adaae31d-051b-44d0-b6a7-ac5e3aa15697 could not be found. Aug 09 11:24:48.061913 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:48.064515 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-0b7bd62c-5f5c-4c0d-9462-acd308a7f5cf tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Returning 404 to user: Instance adaae31d-051b-44d0-b6a7-ac5e3aa15697 could not be found. {{(pid=117684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:24:48.065971 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-0b7bd62c-5f5c-4c0d-9462-acd308a7f5cf tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697" status: 404 len: 111 microversion: 2.1 time: 0.050360 Aug 09 11:24:48.067594 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 471/967] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:24:48 2022] GET /compute/v2.1/servers/adaae31d-051b-44d0-b6a7-ac5e3aa15697 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:24:48.081245 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-011374ab-3ad8-411c-aa78-d4a353a31d5c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:48.081648 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-011374ab-3ad8-411c-aa78-d4a353a31d5c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:48.090078 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-011374ab-3ad8-411c-aa78-d4a353a31d5c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:48.090846 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-011374ab-3ad8-411c-aa78-d4a353a31d5c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:48.091663 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-011374ab-3ad8-411c-aa78-d4a353a31d5c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:48.092482 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-011374ab-3ad8-411c-aa78-d4a353a31d5c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:48.093190 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-011374ab-3ad8-411c-aa78-d4a353a31d5c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:48.093833 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-011374ab-3ad8-411c-aa78-d4a353a31d5c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:48.132112 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-011374ab-3ad8-411c-aa78-d4a353a31d5c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Going to try to terminate instance {{(pid=117685) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 11:24:48.230989 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-011374ab-3ad8-411c-aa78-d4a353a31d5c tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "DELETE /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 204 len: 0 microversion: 2.1 time: 0.157497 Aug 09 11:24:48.231889 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 497/968] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 9 11:24:48 2022] DELETE /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 11:24:48.241373 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-07a5c5cb-cee0-4b8f-b88d-e23125eea807 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:48.242906 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-07a5c5cb-cee0-4b8f-b88d-e23125eea807 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:48.257542 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-07a5c5cb-cee0-4b8f-b88d-e23125eea807 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:48.258756 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-07a5c5cb-cee0-4b8f-b88d-e23125eea807 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:48.259413 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-07a5c5cb-cee0-4b8f-b88d-e23125eea807 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:48.260728 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-07a5c5cb-cee0-4b8f-b88d-e23125eea807 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:48.261405 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-07a5c5cb-cee0-4b8f-b88d-e23125eea807 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:48.262485 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-07a5c5cb-cee0-4b8f-b88d-e23125eea807 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:48.485777 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-07a5c5cb-cee0-4b8f-b88d-e23125eea807 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:48.494481 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-07a5c5cb-cee0-4b8f-b88d-e23125eea807 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.257427 Aug 09 11:24:48.495144 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 472/969] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:24:48 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:24:49.154507 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-390c47ab-4607-4fb5-8ecd-eb8c7ba2a8bd tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:49.155059 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-390c47ab-4607-4fb5-8ecd-eb8c7ba2a8bd tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: c883c714-443c-4df9-aaa0-8e7e81764fc2] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:49.162321 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-390c47ab-4607-4fb5-8ecd-eb8c7ba2a8bd tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:49.162992 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-390c47ab-4607-4fb5-8ecd-eb8c7ba2a8bd tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:49.163509 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-390c47ab-4607-4fb5-8ecd-eb8c7ba2a8bd tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:49.164284 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-390c47ab-4607-4fb5-8ecd-eb8c7ba2a8bd tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:49.164844 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-390c47ab-4607-4fb5-8ecd-eb8c7ba2a8bd tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:49.165268 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-390c47ab-4607-4fb5-8ecd-eb8c7ba2a8bd tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:49.185962 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.wsgi [None req-390c47ab-4607-4fb5-8ecd-eb8c7ba2a8bd tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] HTTP exception thrown: Instance c883c714-443c-4df9-aaa0-8e7e81764fc2 could not be found. Aug 09 11:24:49.187661 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-390c47ab-4607-4fb5-8ecd-eb8c7ba2a8bd tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Request method failure captured: Aug 09 11:24:49.187661 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: request: DELETE /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2 HTTP/1.1 Aug 09 11:24:49.187661 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Accept: application/json Aug 09 11:24:49.187661 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Accept-Encoding: identity Aug 09 11:24:49.187661 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Connection: close Aug 09 11:24:49.187661 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Content-Length: 0 Aug 09 11:24:49.187661 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Content-Type: application/json Aug 09 11:24:49.187661 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Host: 10.222.0.27 Aug 09 11:24:49.187661 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Openstack-System-Scope: None Aug 09 11:24:49.187661 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: User-Agent: python-urllib3/1.26.11 Aug 09 11:24:49.187661 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Auth-Token: gAAAAABi8kJrkCuZ0ZtlZIUmAC-EK2I0okp8exzRXbUBoHrpFGaG17TfS3kn4sSvkBzyMOMoCBQBmvOs9UrhF5xw2U46aP5Pxlq5Kj8piUuPsDzn7s8ETM_3P18gyColYBDIhcjSMUGohuoeVN3S8QIKYIofZURyiH1QY4Vi6NWdxWuymPkih0k Aug 09 11:24:49.187661 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Domain-Id: None Aug 09 11:24:49.187661 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Domain-Name: None Aug 09 11:24:49.187661 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Identity-Status: Confirmed Aug 09 11:24:49.187661 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Is-Admin-Project: True Aug 09 11:24:49.187661 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Domain-Id: default Aug 09 11:24:49.187661 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Domain-Name: Default Aug 09 11:24:49.187661 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Id: cba1dd0b689b4fff847b6fd3787b143c Aug 09 11:24:49.187661 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Name: tempest-AttachVolumeNegativeTest-1410930012 Aug 09 11:24:49.187661 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Role: member,reader Aug 09 11:24:49.187661 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Roles: member,reader Aug 09 11:24:49.189243 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:24:49.189243 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant: tempest-AttachVolumeNegativeTest-1410930012 Aug 09 11:24:49.189243 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant-Id: cba1dd0b689b4fff847b6fd3787b143c Aug 09 11:24:49.189243 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1410930012 Aug 09 11:24:49.189243 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User: tempest-AttachVolumeNegativeTest-1410930012-project Aug 09 11:24:49.189243 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Domain-Id: default Aug 09 11:24:49.189243 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Domain-Name: Default Aug 09 11:24:49.189243 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Id: f4da6dd860bb45d1a703a18c2512ffe4 Aug 09 11:24:49.189243 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Name: tempest-AttachVolumeNegativeTest-1410930012-project Aug 09 11:24:49.189243 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: method: > Aug 09 11:24:49.189243 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: exception: Instance c883c714-443c-4df9-aaa0-8e7e81764fc2 could not be found. Aug 09 11:24:49.189243 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: action_args: {'id': 'c883c714-443c-4df9-aaa0-8e7e81764fc2'} Aug 09 11:24:49.190310 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:24:49.190310 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:24:49.190310 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:24:49.190310 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:24:49.190310 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:24:49.190310 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:24:49.190310 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:24:49.190310 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:24:49.190310 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:24:49.190310 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:24:49.190310 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c883c714-443c-4df9-aaa0-8e7e81764fc2 could not be found. Aug 09 11:24:49.190310 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:24:49.190310 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:24:49.190310 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:24:49.190310 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:24:49.190310 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:24:49.190310 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:24:49.190310 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:24:49.190310 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:24:49.190310 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:24:49.191933 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:24:49.191933 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 11:24:49.191933 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 11:24:49.191933 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 11:24:49.191933 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 11:24:49.191933 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:24:49.191933 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:24:49.191933 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:24:49.191933 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:24:49.191933 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c883c714-443c-4df9-aaa0-8e7e81764fc2 could not be found. Aug 09 11:24:49.191933 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:24:49.191933 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:24:49.191933 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:24:49.191933 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:24:49.191933 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:24:49.191933 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:24:49.191933 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:24:49.191933 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:24:49.191933 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c883c714-443c-4df9-aaa0-8e7e81764fc2 could not be found. Aug 09 11:24:49.191933 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:24:49.193874 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-390c47ab-4607-4fb5-8ecd-eb8c7ba2a8bd tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Returning 404 to user: Instance c883c714-443c-4df9-aaa0-8e7e81764fc2 could not be found. {{(pid=117685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:24:49.193874 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-390c47ab-4607-4fb5-8ecd-eb8c7ba2a8bd tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2" status: 404 len: 111 microversion: 2.1 time: 0.038989 Aug 09 11:24:49.193874 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 498/970] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 9 11:24:49 2022] DELETE /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:24:49.198206 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-9902eb23-7c99-4cd7-9fa6-7b7241a371af tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:49.198813 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-9902eb23-7c99-4cd7-9fa6-7b7241a371af tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: c883c714-443c-4df9-aaa0-8e7e81764fc2] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:49.205543 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9902eb23-7c99-4cd7-9fa6-7b7241a371af tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:49.206099 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9902eb23-7c99-4cd7-9fa6-7b7241a371af tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:49.206673 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9902eb23-7c99-4cd7-9fa6-7b7241a371af tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:49.207371 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9902eb23-7c99-4cd7-9fa6-7b7241a371af tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:49.207816 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9902eb23-7c99-4cd7-9fa6-7b7241a371af tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:49.208234 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9902eb23-7c99-4cd7-9fa6-7b7241a371af tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:49.222409 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.wsgi [None req-9902eb23-7c99-4cd7-9fa6-7b7241a371af tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] HTTP exception thrown: Instance c883c714-443c-4df9-aaa0-8e7e81764fc2 could not be found. Aug 09 11:24:49.224231 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-9902eb23-7c99-4cd7-9fa6-7b7241a371af tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Request method failure captured: Aug 09 11:24:49.224231 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: request: GET /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2 HTTP/1.1 Aug 09 11:24:49.224231 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept: application/json Aug 09 11:24:49.224231 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept-Encoding: identity Aug 09 11:24:49.224231 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Connection: close Aug 09 11:24:49.224231 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Length: 0 Aug 09 11:24:49.224231 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Type: application/json Aug 09 11:24:49.224231 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Host: 10.222.0.27 Aug 09 11:24:49.224231 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Openstack-System-Scope: None Aug 09 11:24:49.224231 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: User-Agent: python-urllib3/1.26.11 Aug 09 11:24:49.224231 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Auth-Token: gAAAAABi8kJrkCuZ0ZtlZIUmAC-EK2I0okp8exzRXbUBoHrpFGaG17TfS3kn4sSvkBzyMOMoCBQBmvOs9UrhF5xw2U46aP5Pxlq5Kj8piUuPsDzn7s8ETM_3P18gyColYBDIhcjSMUGohuoeVN3S8QIKYIofZURyiH1QY4Vi6NWdxWuymPkih0k Aug 09 11:24:49.224231 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Id: None Aug 09 11:24:49.224231 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Name: None Aug 09 11:24:49.224231 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Identity-Status: Confirmed Aug 09 11:24:49.224231 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Is-Admin-Project: True Aug 09 11:24:49.224231 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Id: default Aug 09 11:24:49.224231 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Name: Default Aug 09 11:24:49.224231 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Id: cba1dd0b689b4fff847b6fd3787b143c Aug 09 11:24:49.224231 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Name: tempest-AttachVolumeNegativeTest-1410930012 Aug 09 11:24:49.224231 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Role: member,reader Aug 09 11:24:49.224231 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Roles: member,reader Aug 09 11:24:49.225860 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:24:49.225860 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant: tempest-AttachVolumeNegativeTest-1410930012 Aug 09 11:24:49.225860 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Id: cba1dd0b689b4fff847b6fd3787b143c Aug 09 11:24:49.225860 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1410930012 Aug 09 11:24:49.225860 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User: tempest-AttachVolumeNegativeTest-1410930012-project Aug 09 11:24:49.225860 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Id: default Aug 09 11:24:49.225860 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Name: Default Aug 09 11:24:49.225860 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Id: f4da6dd860bb45d1a703a18c2512ffe4 Aug 09 11:24:49.225860 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Name: tempest-AttachVolumeNegativeTest-1410930012-project Aug 09 11:24:49.225860 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: method: > Aug 09 11:24:49.225860 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: exception: Instance c883c714-443c-4df9-aaa0-8e7e81764fc2 could not be found. Aug 09 11:24:49.225860 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: action_args: {'id': 'c883c714-443c-4df9-aaa0-8e7e81764fc2'} Aug 09 11:24:49.226651 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:24:49.226651 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:24:49.226651 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:24:49.226651 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:24:49.226651 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:24:49.226651 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:24:49.226651 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:24:49.226651 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:24:49.226651 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:24:49.226651 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:24:49.226651 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c883c714-443c-4df9-aaa0-8e7e81764fc2 could not be found. Aug 09 11:24:49.226651 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:49.226651 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:24:49.226651 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:49.226651 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:24:49.226651 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:24:49.226651 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:24:49.226651 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:24:49.226651 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:24:49.226651 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:24:49.227979 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:24:49.227979 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:24:49.227979 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:24:49.227979 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:24:49.227979 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:24:49.227979 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:24:49.227979 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:24:49.227979 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c883c714-443c-4df9-aaa0-8e7e81764fc2 could not be found. Aug 09 11:24:49.227979 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:49.227979 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:24:49.227979 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:49.227979 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:24:49.227979 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:24:49.227979 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:24:49.227979 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:24:49.227979 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:24:49.227979 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c883c714-443c-4df9-aaa0-8e7e81764fc2 could not be found. Aug 09 11:24:49.227979 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:49.229217 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-9902eb23-7c99-4cd7-9fa6-7b7241a371af tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Returning 404 to user: Instance c883c714-443c-4df9-aaa0-8e7e81764fc2 could not be found. {{(pid=117684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:24:49.229217 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-9902eb23-7c99-4cd7-9fa6-7b7241a371af tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2" status: 404 len: 111 microversion: 2.1 time: 0.031372 Aug 09 11:24:49.229217 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 473/971] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:24:49 2022] GET /compute/v2.1/servers/c883c714-443c-4df9-aaa0-8e7e81764fc2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:24:49.234818 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-76b613e5-8158-4049-8725-9bf6984aba4e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:49.235313 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-76b613e5-8158-4049-8725-9bf6984aba4e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: eee55879-1bf3-41e4-b439-0c903100e828] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:49.241299 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-76b613e5-8158-4049-8725-9bf6984aba4e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:49.241770 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-76b613e5-8158-4049-8725-9bf6984aba4e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:49.242191 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-76b613e5-8158-4049-8725-9bf6984aba4e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:49.242872 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-76b613e5-8158-4049-8725-9bf6984aba4e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:49.243315 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-76b613e5-8158-4049-8725-9bf6984aba4e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:49.243725 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-76b613e5-8158-4049-8725-9bf6984aba4e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:49.257804 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.wsgi [None req-76b613e5-8158-4049-8725-9bf6984aba4e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] HTTP exception thrown: Instance eee55879-1bf3-41e4-b439-0c903100e828 could not be found. Aug 09 11:24:49.259511 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-76b613e5-8158-4049-8725-9bf6984aba4e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Request method failure captured: Aug 09 11:24:49.259511 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: request: DELETE /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828 HTTP/1.1 Aug 09 11:24:49.259511 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Accept: application/json Aug 09 11:24:49.259511 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Accept-Encoding: identity Aug 09 11:24:49.259511 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Connection: close Aug 09 11:24:49.259511 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Content-Length: 0 Aug 09 11:24:49.259511 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Content-Type: application/json Aug 09 11:24:49.259511 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Host: 10.222.0.27 Aug 09 11:24:49.259511 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Openstack-System-Scope: None Aug 09 11:24:49.259511 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: User-Agent: python-urllib3/1.26.11 Aug 09 11:24:49.259511 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Auth-Token: gAAAAABi8kJrkCuZ0ZtlZIUmAC-EK2I0okp8exzRXbUBoHrpFGaG17TfS3kn4sSvkBzyMOMoCBQBmvOs9UrhF5xw2U46aP5Pxlq5Kj8piUuPsDzn7s8ETM_3P18gyColYBDIhcjSMUGohuoeVN3S8QIKYIofZURyiH1QY4Vi6NWdxWuymPkih0k Aug 09 11:24:49.259511 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Domain-Id: None Aug 09 11:24:49.259511 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Domain-Name: None Aug 09 11:24:49.259511 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Identity-Status: Confirmed Aug 09 11:24:49.259511 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Is-Admin-Project: True Aug 09 11:24:49.259511 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Domain-Id: default Aug 09 11:24:49.259511 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Domain-Name: Default Aug 09 11:24:49.259511 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Id: cba1dd0b689b4fff847b6fd3787b143c Aug 09 11:24:49.259511 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Name: tempest-AttachVolumeNegativeTest-1410930012 Aug 09 11:24:49.259511 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Role: member,reader Aug 09 11:24:49.259511 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Roles: member,reader Aug 09 11:24:49.261040 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:24:49.261040 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant: tempest-AttachVolumeNegativeTest-1410930012 Aug 09 11:24:49.261040 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant-Id: cba1dd0b689b4fff847b6fd3787b143c Aug 09 11:24:49.261040 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1410930012 Aug 09 11:24:49.261040 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User: tempest-AttachVolumeNegativeTest-1410930012-project Aug 09 11:24:49.261040 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Domain-Id: default Aug 09 11:24:49.261040 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Domain-Name: Default Aug 09 11:24:49.261040 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Id: f4da6dd860bb45d1a703a18c2512ffe4 Aug 09 11:24:49.261040 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Name: tempest-AttachVolumeNegativeTest-1410930012-project Aug 09 11:24:49.261040 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: method: > Aug 09 11:24:49.261040 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: exception: Instance eee55879-1bf3-41e4-b439-0c903100e828 could not be found. Aug 09 11:24:49.261040 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: action_args: {'id': 'eee55879-1bf3-41e4-b439-0c903100e828'} Aug 09 11:24:49.261836 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:24:49.261836 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:24:49.261836 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:24:49.261836 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:24:49.261836 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:24:49.261836 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:24:49.261836 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:24:49.261836 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:24:49.261836 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:24:49.261836 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:24:49.261836 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eee55879-1bf3-41e4-b439-0c903100e828 could not be found. Aug 09 11:24:49.261836 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:24:49.261836 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:24:49.261836 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:24:49.261836 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:24:49.261836 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:24:49.261836 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:24:49.261836 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:24:49.261836 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:24:49.261836 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:24:49.263049 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:24:49.263049 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 11:24:49.263049 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 11:24:49.263049 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 11:24:49.263049 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 11:24:49.263049 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:24:49.263049 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:24:49.263049 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:24:49.263049 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:24:49.263049 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eee55879-1bf3-41e4-b439-0c903100e828 could not be found. Aug 09 11:24:49.263049 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:24:49.263049 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:24:49.263049 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:24:49.263049 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:24:49.263049 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:24:49.263049 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:24:49.263049 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:24:49.263049 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:24:49.263049 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eee55879-1bf3-41e4-b439-0c903100e828 could not be found. Aug 09 11:24:49.263049 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:24:49.264259 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-76b613e5-8158-4049-8725-9bf6984aba4e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Returning 404 to user: Instance eee55879-1bf3-41e4-b439-0c903100e828 could not be found. {{(pid=117685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:24:49.264259 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-76b613e5-8158-4049-8725-9bf6984aba4e tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "DELETE /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828" status: 404 len: 111 microversion: 2.1 time: 0.030940 Aug 09 11:24:49.264259 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 499/972] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 9 11:24:49 2022] DELETE /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:24:49.273101 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-1b85e6cd-2b64-4232-ba0e-3bea33e7e3a0 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:49.273715 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-1b85e6cd-2b64-4232-ba0e-3bea33e7e3a0 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: eee55879-1bf3-41e4-b439-0c903100e828] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:49.279718 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1b85e6cd-2b64-4232-ba0e-3bea33e7e3a0 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:49.280204 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1b85e6cd-2b64-4232-ba0e-3bea33e7e3a0 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:49.280689 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1b85e6cd-2b64-4232-ba0e-3bea33e7e3a0 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:49.281504 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1b85e6cd-2b64-4232-ba0e-3bea33e7e3a0 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:49.281975 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1b85e6cd-2b64-4232-ba0e-3bea33e7e3a0 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:49.282391 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1b85e6cd-2b64-4232-ba0e-3bea33e7e3a0 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:49.296460 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.wsgi [None req-1b85e6cd-2b64-4232-ba0e-3bea33e7e3a0 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] HTTP exception thrown: Instance eee55879-1bf3-41e4-b439-0c903100e828 could not be found. Aug 09 11:24:49.298016 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-1b85e6cd-2b64-4232-ba0e-3bea33e7e3a0 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Request method failure captured: Aug 09 11:24:49.298016 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: request: GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828 HTTP/1.1 Aug 09 11:24:49.298016 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept: application/json Aug 09 11:24:49.298016 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept-Encoding: identity Aug 09 11:24:49.298016 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Connection: close Aug 09 11:24:49.298016 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Length: 0 Aug 09 11:24:49.298016 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Type: application/json Aug 09 11:24:49.298016 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Host: 10.222.0.27 Aug 09 11:24:49.298016 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Openstack-System-Scope: None Aug 09 11:24:49.298016 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: User-Agent: python-urllib3/1.26.11 Aug 09 11:24:49.298016 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Auth-Token: gAAAAABi8kJrkCuZ0ZtlZIUmAC-EK2I0okp8exzRXbUBoHrpFGaG17TfS3kn4sSvkBzyMOMoCBQBmvOs9UrhF5xw2U46aP5Pxlq5Kj8piUuPsDzn7s8ETM_3P18gyColYBDIhcjSMUGohuoeVN3S8QIKYIofZURyiH1QY4Vi6NWdxWuymPkih0k Aug 09 11:24:49.298016 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Id: None Aug 09 11:24:49.298016 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Name: None Aug 09 11:24:49.298016 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Identity-Status: Confirmed Aug 09 11:24:49.298016 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Is-Admin-Project: True Aug 09 11:24:49.298016 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Id: default Aug 09 11:24:49.298016 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Name: Default Aug 09 11:24:49.298016 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Id: cba1dd0b689b4fff847b6fd3787b143c Aug 09 11:24:49.298016 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Name: tempest-AttachVolumeNegativeTest-1410930012 Aug 09 11:24:49.298016 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Role: member,reader Aug 09 11:24:49.298016 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Roles: member,reader Aug 09 11:24:49.299442 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:24:49.299442 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant: tempest-AttachVolumeNegativeTest-1410930012 Aug 09 11:24:49.299442 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Id: cba1dd0b689b4fff847b6fd3787b143c Aug 09 11:24:49.299442 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1410930012 Aug 09 11:24:49.299442 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User: tempest-AttachVolumeNegativeTest-1410930012-project Aug 09 11:24:49.299442 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Id: default Aug 09 11:24:49.299442 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Name: Default Aug 09 11:24:49.299442 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Id: f4da6dd860bb45d1a703a18c2512ffe4 Aug 09 11:24:49.299442 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Name: tempest-AttachVolumeNegativeTest-1410930012-project Aug 09 11:24:49.299442 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: method: > Aug 09 11:24:49.299442 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: exception: Instance eee55879-1bf3-41e4-b439-0c903100e828 could not be found. Aug 09 11:24:49.299442 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: action_args: {'id': 'eee55879-1bf3-41e4-b439-0c903100e828'} Aug 09 11:24:49.300311 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:24:49.300311 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:24:49.300311 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:24:49.300311 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:24:49.300311 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:24:49.300311 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:24:49.300311 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:24:49.300311 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:24:49.300311 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:24:49.300311 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:24:49.300311 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eee55879-1bf3-41e4-b439-0c903100e828 could not be found. Aug 09 11:24:49.300311 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:49.300311 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:24:49.300311 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:49.300311 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:24:49.300311 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:24:49.300311 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:24:49.300311 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:24:49.300311 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:24:49.300311 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:24:49.301635 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:24:49.301635 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:24:49.301635 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:24:49.301635 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:24:49.301635 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:24:49.301635 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:24:49.301635 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:24:49.301635 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eee55879-1bf3-41e4-b439-0c903100e828 could not be found. Aug 09 11:24:49.301635 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:49.301635 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:24:49.301635 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:49.301635 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:24:49.301635 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:24:49.301635 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:24:49.301635 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:24:49.301635 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:24:49.301635 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eee55879-1bf3-41e4-b439-0c903100e828 could not be found. Aug 09 11:24:49.301635 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:49.302848 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-1b85e6cd-2b64-4232-ba0e-3bea33e7e3a0 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Returning 404 to user: Instance eee55879-1bf3-41e4-b439-0c903100e828 could not be found. {{(pid=117684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:24:49.302848 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-1b85e6cd-2b64-4232-ba0e-3bea33e7e3a0 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828" status: 404 len: 111 microversion: 2.1 time: 0.030761 Aug 09 11:24:49.303439 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 474/973] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:24:49 2022] GET /compute/v2.1/servers/eee55879-1bf3-41e4-b439-0c903100e828 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:24:49.523504 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-25de35ea-92d9-46ae-b525-4c2a758eb775 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:49.524225 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-25de35ea-92d9-46ae-b525-4c2a758eb775 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:49.531305 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-25de35ea-92d9-46ae-b525-4c2a758eb775 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:49.531832 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-25de35ea-92d9-46ae-b525-4c2a758eb775 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:49.532375 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-25de35ea-92d9-46ae-b525-4c2a758eb775 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:49.533293 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-25de35ea-92d9-46ae-b525-4c2a758eb775 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:49.533814 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-25de35ea-92d9-46ae-b525-4c2a758eb775 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:49.535033 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-25de35ea-92d9-46ae-b525-4c2a758eb775 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:49.707283 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-25de35ea-92d9-46ae-b525-4c2a758eb775 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:49.715123 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-25de35ea-92d9-46ae-b525-4c2a758eb775 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1522 microversion: 2.1 time: 0.196729 Aug 09 11:24:49.715976 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 500/974] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:24:49 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:24:50.479481 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-d65f68a1-e6d4-4ccc-9574-93c35e1ff042 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:50.480355 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-d65f68a1-e6d4-4ccc-9574-93c35e1ff042 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 1329e8e9-9358-454d-bea3-dad19dfc53da] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:50.487907 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d65f68a1-e6d4-4ccc-9574-93c35e1ff042 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:50.488330 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d65f68a1-e6d4-4ccc-9574-93c35e1ff042 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:50.488811 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d65f68a1-e6d4-4ccc-9574-93c35e1ff042 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:50.489581 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d65f68a1-e6d4-4ccc-9574-93c35e1ff042 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:50.490128 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d65f68a1-e6d4-4ccc-9574-93c35e1ff042 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:50.491443 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-d65f68a1-e6d4-4ccc-9574-93c35e1ff042 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:50.507121 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.wsgi [None req-d65f68a1-e6d4-4ccc-9574-93c35e1ff042 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] HTTP exception thrown: Instance 1329e8e9-9358-454d-bea3-dad19dfc53da could not be found. Aug 09 11:24:50.508735 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-d65f68a1-e6d4-4ccc-9574-93c35e1ff042 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Request method failure captured: Aug 09 11:24:50.508735 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: request: DELETE /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da HTTP/1.1 Aug 09 11:24:50.508735 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept: application/json Aug 09 11:24:50.508735 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept-Encoding: identity Aug 09 11:24:50.508735 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Connection: close Aug 09 11:24:50.508735 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Length: 0 Aug 09 11:24:50.508735 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Type: application/json Aug 09 11:24:50.508735 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Host: 10.222.0.27 Aug 09 11:24:50.508735 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Openstack-System-Scope: None Aug 09 11:24:50.508735 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: User-Agent: python-urllib3/1.26.11 Aug 09 11:24:50.508735 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Auth-Token: gAAAAABi8kJrkCuZ0ZtlZIUmAC-EK2I0okp8exzRXbUBoHrpFGaG17TfS3kn4sSvkBzyMOMoCBQBmvOs9UrhF5xw2U46aP5Pxlq5Kj8piUuPsDzn7s8ETM_3P18gyColYBDIhcjSMUGohuoeVN3S8QIKYIofZURyiH1QY4Vi6NWdxWuymPkih0k Aug 09 11:24:50.508735 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Id: None Aug 09 11:24:50.508735 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Name: None Aug 09 11:24:50.508735 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Identity-Status: Confirmed Aug 09 11:24:50.508735 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Is-Admin-Project: True Aug 09 11:24:50.508735 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Id: default Aug 09 11:24:50.508735 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Name: Default Aug 09 11:24:50.508735 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Id: cba1dd0b689b4fff847b6fd3787b143c Aug 09 11:24:50.508735 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Name: tempest-AttachVolumeNegativeTest-1410930012 Aug 09 11:24:50.508735 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Role: member,reader Aug 09 11:24:50.508735 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Roles: member,reader Aug 09 11:24:50.510397 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:24:50.510397 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant: tempest-AttachVolumeNegativeTest-1410930012 Aug 09 11:24:50.510397 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Id: cba1dd0b689b4fff847b6fd3787b143c Aug 09 11:24:50.510397 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1410930012 Aug 09 11:24:50.510397 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User: tempest-AttachVolumeNegativeTest-1410930012-project Aug 09 11:24:50.510397 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Id: default Aug 09 11:24:50.510397 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Name: Default Aug 09 11:24:50.510397 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Id: f4da6dd860bb45d1a703a18c2512ffe4 Aug 09 11:24:50.510397 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Name: tempest-AttachVolumeNegativeTest-1410930012-project Aug 09 11:24:50.510397 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: method: > Aug 09 11:24:50.510397 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: exception: Instance 1329e8e9-9358-454d-bea3-dad19dfc53da could not be found. Aug 09 11:24:50.510397 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: action_args: {'id': '1329e8e9-9358-454d-bea3-dad19dfc53da'} Aug 09 11:24:50.511368 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:24:50.511368 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:24:50.511368 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:24:50.511368 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:24:50.511368 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:24:50.511368 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:24:50.511368 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:24:50.511368 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:24:50.511368 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:24:50.511368 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:24:50.511368 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1329e8e9-9358-454d-bea3-dad19dfc53da could not be found. Aug 09 11:24:50.511368 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:50.511368 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:24:50.511368 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:50.511368 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:24:50.511368 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:24:50.511368 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:24:50.511368 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:24:50.511368 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:24:50.511368 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:24:50.512613 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:24:50.512613 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 11:24:50.512613 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 11:24:50.512613 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 11:24:50.512613 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 11:24:50.512613 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:24:50.512613 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:24:50.512613 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:24:50.512613 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:24:50.512613 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1329e8e9-9358-454d-bea3-dad19dfc53da could not be found. Aug 09 11:24:50.512613 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:50.512613 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:24:50.512613 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:50.512613 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:24:50.512613 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:24:50.512613 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:24:50.512613 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:24:50.512613 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:24:50.512613 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1329e8e9-9358-454d-bea3-dad19dfc53da could not be found. Aug 09 11:24:50.512613 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:24:50.514273 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-d65f68a1-e6d4-4ccc-9574-93c35e1ff042 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Returning 404 to user: Instance 1329e8e9-9358-454d-bea3-dad19dfc53da could not be found. {{(pid=117684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:24:50.514273 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-d65f68a1-e6d4-4ccc-9574-93c35e1ff042 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da" status: 404 len: 111 microversion: 2.1 time: 0.035194 Aug 09 11:24:50.514273 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 475/975] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 9 11:24:50 2022] DELETE /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:24:50.518916 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-94723abb-9d99-4ab2-8f3b-7d2b591e9563 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:50.519519 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-94723abb-9d99-4ab2-8f3b-7d2b591e9563 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] [instance: 1329e8e9-9358-454d-bea3-dad19dfc53da] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:50.526270 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-94723abb-9d99-4ab2-8f3b-7d2b591e9563 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:50.526742 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-94723abb-9d99-4ab2-8f3b-7d2b591e9563 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:50.527166 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-94723abb-9d99-4ab2-8f3b-7d2b591e9563 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:50.527858 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-94723abb-9d99-4ab2-8f3b-7d2b591e9563 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:50.528319 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-94723abb-9d99-4ab2-8f3b-7d2b591e9563 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:50.528738 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-94723abb-9d99-4ab2-8f3b-7d2b591e9563 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:50.542671 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.wsgi [None req-94723abb-9d99-4ab2-8f3b-7d2b591e9563 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] HTTP exception thrown: Instance 1329e8e9-9358-454d-bea3-dad19dfc53da could not be found. Aug 09 11:24:50.544384 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-94723abb-9d99-4ab2-8f3b-7d2b591e9563 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Request method failure captured: Aug 09 11:24:50.544384 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: request: GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da HTTP/1.1 Aug 09 11:24:50.544384 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Accept: application/json Aug 09 11:24:50.544384 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Accept-Encoding: identity Aug 09 11:24:50.544384 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Connection: close Aug 09 11:24:50.544384 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Content-Length: 0 Aug 09 11:24:50.544384 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Content-Type: application/json Aug 09 11:24:50.544384 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Host: 10.222.0.27 Aug 09 11:24:50.544384 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Openstack-System-Scope: None Aug 09 11:24:50.544384 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: User-Agent: python-urllib3/1.26.11 Aug 09 11:24:50.544384 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Auth-Token: gAAAAABi8kJrkCuZ0ZtlZIUmAC-EK2I0okp8exzRXbUBoHrpFGaG17TfS3kn4sSvkBzyMOMoCBQBmvOs9UrhF5xw2U46aP5Pxlq5Kj8piUuPsDzn7s8ETM_3P18gyColYBDIhcjSMUGohuoeVN3S8QIKYIofZURyiH1QY4Vi6NWdxWuymPkih0k Aug 09 11:24:50.544384 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Domain-Id: None Aug 09 11:24:50.544384 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Domain-Name: None Aug 09 11:24:50.544384 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Identity-Status: Confirmed Aug 09 11:24:50.544384 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Is-Admin-Project: True Aug 09 11:24:50.544384 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Domain-Id: default Aug 09 11:24:50.544384 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Domain-Name: Default Aug 09 11:24:50.544384 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Id: cba1dd0b689b4fff847b6fd3787b143c Aug 09 11:24:50.544384 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Name: tempest-AttachVolumeNegativeTest-1410930012 Aug 09 11:24:50.544384 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Role: member,reader Aug 09 11:24:50.544384 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Roles: member,reader Aug 09 11:24:50.545785 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cba1dd0b689b4fff847b6fd3787b143c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:24:50.545785 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant: tempest-AttachVolumeNegativeTest-1410930012 Aug 09 11:24:50.545785 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant-Id: cba1dd0b689b4fff847b6fd3787b143c Aug 09 11:24:50.545785 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1410930012 Aug 09 11:24:50.545785 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User: tempest-AttachVolumeNegativeTest-1410930012-project Aug 09 11:24:50.545785 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Domain-Id: default Aug 09 11:24:50.545785 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Domain-Name: Default Aug 09 11:24:50.545785 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Id: f4da6dd860bb45d1a703a18c2512ffe4 Aug 09 11:24:50.545785 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Name: tempest-AttachVolumeNegativeTest-1410930012-project Aug 09 11:24:50.545785 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: method: > Aug 09 11:24:50.545785 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: exception: Instance 1329e8e9-9358-454d-bea3-dad19dfc53da could not be found. Aug 09 11:24:50.545785 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: action_args: {'id': '1329e8e9-9358-454d-bea3-dad19dfc53da'} Aug 09 11:24:50.546572 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:24:50.546572 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:24:50.546572 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:24:50.546572 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:24:50.546572 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:24:50.546572 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:24:50.546572 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:24:50.546572 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:24:50.546572 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:24:50.546572 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:24:50.546572 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1329e8e9-9358-454d-bea3-dad19dfc53da could not be found. Aug 09 11:24:50.546572 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:24:50.546572 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:24:50.546572 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:24:50.546572 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:24:50.546572 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:24:50.546572 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:24:50.546572 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:24:50.546572 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:24:50.546572 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:24:50.547920 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:24:50.547920 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:24:50.547920 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:24:50.547920 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:24:50.547920 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:24:50.547920 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:24:50.547920 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:24:50.547920 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1329e8e9-9358-454d-bea3-dad19dfc53da could not be found. Aug 09 11:24:50.547920 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:24:50.547920 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:24:50.547920 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:24:50.547920 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:24:50.547920 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:24:50.547920 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:24:50.547920 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:24:50.547920 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:24:50.547920 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1329e8e9-9358-454d-bea3-dad19dfc53da could not be found. Aug 09 11:24:50.547920 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:24:50.550288 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-94723abb-9d99-4ab2-8f3b-7d2b591e9563 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] Returning 404 to user: Instance 1329e8e9-9358-454d-bea3-dad19dfc53da could not be found. {{(pid=117685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:24:50.550288 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-94723abb-9d99-4ab2-8f3b-7d2b591e9563 tempest-AttachVolumeNegativeTest-1410930012 tempest-AttachVolumeNegativeTest-1410930012-project] 10.222.0.27 "GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da" status: 404 len: 111 microversion: 2.1 time: 0.031155 Aug 09 11:24:50.550288 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 501/976] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:24:50 2022] GET /compute/v2.1/servers/1329e8e9-9358-454d-bea3-dad19dfc53da => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:24:50.750968 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-b7255f0f-95b5-49ef-8fe7-f9b68e5f813d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:50.766855 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-b7255f0f-95b5-49ef-8fe7-f9b68e5f813d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:50.782553 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b7255f0f-95b5-49ef-8fe7-f9b68e5f813d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:50.783487 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b7255f0f-95b5-49ef-8fe7-f9b68e5f813d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:50.787334 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b7255f0f-95b5-49ef-8fe7-f9b68e5f813d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:50.788210 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b7255f0f-95b5-49ef-8fe7-f9b68e5f813d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:50.790235 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b7255f0f-95b5-49ef-8fe7-f9b68e5f813d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:50.791729 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b7255f0f-95b5-49ef-8fe7-f9b68e5f813d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:50.820007 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-8b8d673f-81d9-4127-adf5-75a730eb6513 req-85ec48e7-7c0f-45cf-961c-3a978ad9058b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41447c00-5903-4495-9529-ec080a0840c1", "name": "network-vif-deleted", "tag": "60ac3d32-12ed-40f1-8fe2-2f77df55feb9"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:24:50.832147 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-8b8d673f-81d9-4127-adf5-75a730eb6513 req-85ec48e7-7c0f-45cf-961c-3a978ad9058b service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:50.833113 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-8b8d673f-81d9-4127-adf5-75a730eb6513 req-85ec48e7-7c0f-45cf-961c-3a978ad9058b service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:50.833839 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-8b8d673f-81d9-4127-adf5-75a730eb6513 req-85ec48e7-7c0f-45cf-961c-3a978ad9058b service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:50.848908 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-8b8d673f-81d9-4127-adf5-75a730eb6513 req-85ec48e7-7c0f-45cf-961c-3a978ad9058b service nova] Creating event network-vif-deleted:60ac3d32-12ed-40f1-8fe2-2f77df55feb9 for instance 41447c00-5903-4495-9529-ec080a0840c1 on hv-cinder-85251 Aug 09 11:24:50.856023 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-8b8d673f-81d9-4127-adf5-75a730eb6513 req-85ec48e7-7c0f-45cf-961c-3a978ad9058b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039770 Aug 09 11:24:50.857016 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 502/977] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:24:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:24:50.926712 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-b7255f0f-95b5-49ef-8fe7-f9b68e5f813d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd35a257f4b0f99141580c14bad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bb3a603ddc4d3b8042b6ae687c896e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:24:50.935376 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-b7255f0f-95b5-49ef-8fe7-f9b68e5f813d tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 200 len: 1480 microversion: 2.1 time: 0.194421 Aug 09 11:24:50.936538 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 476/978] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:24:50 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 1480 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:24:51.959078 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-6c427ac7-0934-4e9e-9094-4e70113858b7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:51.959916 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-6c427ac7-0934-4e9e-9094-4e70113858b7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] [instance: 41447c00-5903-4495-9529-ec080a0840c1] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:24:51.972938 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6c427ac7-0934-4e9e-9094-4e70113858b7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:51.973426 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6c427ac7-0934-4e9e-9094-4e70113858b7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:51.973855 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6c427ac7-0934-4e9e-9094-4e70113858b7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:51.974561 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6c427ac7-0934-4e9e-9094-4e70113858b7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:51.974995 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6c427ac7-0934-4e9e-9094-4e70113858b7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:51.975593 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6c427ac7-0934-4e9e-9094-4e70113858b7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:51.993417 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.wsgi [None req-6c427ac7-0934-4e9e-9094-4e70113858b7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] HTTP exception thrown: Instance 41447c00-5903-4495-9529-ec080a0840c1 could not be found. Aug 09 11:24:51.995339 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-6c427ac7-0934-4e9e-9094-4e70113858b7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Request method failure captured: Aug 09 11:24:51.995339 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: request: GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 HTTP/1.1 Aug 09 11:24:51.995339 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Accept: application/json Aug 09 11:24:51.995339 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Accept-Encoding: identity Aug 09 11:24:51.995339 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Connection: close Aug 09 11:24:51.995339 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Content-Length: 0 Aug 09 11:24:51.995339 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Content-Type: application/json Aug 09 11:24:51.995339 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Host: 10.222.0.27 Aug 09 11:24:51.995339 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Openstack-System-Scope: None Aug 09 11:24:51.995339 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: User-Agent: python-urllib3/1.26.11 Aug 09 11:24:51.995339 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Auth-Token: gAAAAABi8kK4ZURPQKT-E-bhJo1FLIIqaFjoTaLi0t_9gs19mh3N7gqZ6GeAerCuuiTJe0dYAhdQ2iR_bfI_b0ZwFkvbIx4r8Jm4-7nh0tWhT2kBjRkOHrLdvaHoe9ZT_a_-HZxYdn72f859LpQhFNf_Fvg_jqnrIaRWCS_QgEMwXjTJVjY3_8I Aug 09 11:24:51.995339 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Domain-Id: None Aug 09 11:24:51.995339 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Domain-Name: None Aug 09 11:24:51.995339 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Identity-Status: Confirmed Aug 09 11:24:51.995339 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Is-Admin-Project: True Aug 09 11:24:51.995339 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Domain-Id: default Aug 09 11:24:51.995339 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Domain-Name: Default Aug 09 11:24:51.995339 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Id: 45bb3a603ddc4d3b8042b6ae687c896e Aug 09 11:24:51.995339 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-338750798 Aug 09 11:24:51.995339 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Role: member,reader Aug 09 11:24:51.995339 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Roles: member,reader Aug 09 11:24:51.996925 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/45bb3a603ddc4d3b8042b6ae687c896e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_45bb3a603ddc4d3b8042b6ae687c896e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/45bb3a603ddc4d3b8042b6ae687c896e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/45bb3a603ddc4d3b8042b6ae687c896e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:24:51.996925 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant: tempest-ServerRescueNegativeTestJSON-338750798 Aug 09 11:24:51.996925 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant-Id: 45bb3a603ddc4d3b8042b6ae687c896e Aug 09 11:24:51.996925 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-338750798 Aug 09 11:24:51.996925 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User: tempest-ServerRescueNegativeTestJSON-338750798-project Aug 09 11:24:51.996925 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Domain-Id: default Aug 09 11:24:51.996925 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Domain-Name: Default Aug 09 11:24:51.996925 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Id: 3a1cd35a257f4b0f99141580c14bad48 Aug 09 11:24:51.996925 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Name: tempest-ServerRescueNegativeTestJSON-338750798-project Aug 09 11:24:51.996925 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: method: > Aug 09 11:24:51.996925 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: exception: Instance 41447c00-5903-4495-9529-ec080a0840c1 could not be found. Aug 09 11:24:51.996925 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: action_args: {'id': '41447c00-5903-4495-9529-ec080a0840c1'} Aug 09 11:24:51.997794 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:24:51.997794 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:24:51.997794 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:24:51.997794 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:24:51.997794 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:24:51.997794 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:24:51.997794 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:24:51.997794 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:24:51.997794 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:24:51.997794 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:24:51.997794 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41447c00-5903-4495-9529-ec080a0840c1 could not be found. Aug 09 11:24:51.997794 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:24:51.997794 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:24:51.997794 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:24:51.997794 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:24:51.997794 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:24:51.997794 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:24:51.997794 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:24:51.997794 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:24:51.997794 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:24:51.999145 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:24:51.999145 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:24:51.999145 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:24:51.999145 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:24:51.999145 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:24:51.999145 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:24:51.999145 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:24:51.999145 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41447c00-5903-4495-9529-ec080a0840c1 could not be found. Aug 09 11:24:51.999145 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:24:51.999145 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:24:51.999145 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:24:51.999145 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:24:51.999145 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:24:51.999145 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:24:51.999145 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:24:51.999145 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:24:51.999145 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41447c00-5903-4495-9529-ec080a0840c1 could not be found. Aug 09 11:24:51.999145 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:24:52.001571 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-6c427ac7-0934-4e9e-9094-4e70113858b7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] Returning 404 to user: Instance 41447c00-5903-4495-9529-ec080a0840c1 could not be found. {{(pid=117685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:24:52.002617 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-6c427ac7-0934-4e9e-9094-4e70113858b7 tempest-ServerRescueNegativeTestJSON-338750798 tempest-ServerRescueNegativeTestJSON-338750798-project] 10.222.0.27 "GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1" status: 404 len: 111 microversion: 2.1 time: 0.049911 Aug 09 11:24:52.003984 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 503/979] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:24:51 2022] GET /compute/v2.1/servers/41447c00-5903-4495-9529-ec080a0840c1 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:24:58.119726 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-c0559e31-703e-4b96-98b3-299dc01ff7f3 tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] Action: 'create', calling method: .version_select at 0x7f2821e621f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1294632037"}} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:24:58.466339 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-c0559e31-703e-4b96-98b3-299dc01ff7f3 tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.467244 Aug 09 11:24:58.467388 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 477/980] 10.222.0.27 () {60 vars in 1155 bytes} [Tue Aug 9 11:24:57 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 469 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 09 11:24:58.482171 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-ac32936e-ccd2-47e0-b96a-b1ce2810e9d9 tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] Calling method '.version_select at 0x7f2821eebc10>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:58.549471 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-ac32936e-ccd2-47e0-b96a-b1ce2810e9d9 tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/4c5c091a-cd0c-465d-8e3c-f94f106111b2" status: 200 len: 345 microversion: 2.1 time: 0.073281 Aug 09 11:24:58.550055 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 504/981] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 9 11:24:58 2022] GET /compute/v2.1/os-volumes/4c5c091a-cd0c-465d-8e3c-f94f106111b2 => generated 345 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:24:59.563507 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-129e556e-21fc-427b-a231-3332d76a14de tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] Calling method '.version_select at 0x7f2821f4c1f0>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:59.614290 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-129e556e-21fc-427b-a231-3332d76a14de tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/4c5c091a-cd0c-465d-8e3c-f94f106111b2" status: 200 len: 345 microversion: 2.1 time: 0.055084 Aug 09 11:24:59.614846 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 478/982] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 9 11:24:59 2022] GET /compute/v2.1/os-volumes/4c5c091a-cd0c-465d-8e3c-f94f106111b2 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:25:00.629554 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-ffd1f6c1-e903-4732-875e-f6111eb4165d tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] Calling method '.version_select at 0x7f2822020160>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:00.679138 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-ffd1f6c1-e903-4732-875e-f6111eb4165d tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/4c5c091a-cd0c-465d-8e3c-f94f106111b2" status: 200 len: 345 microversion: 2.1 time: 0.054491 Aug 09 11:25:00.685872 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 505/983] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 9 11:25:00 2022] GET /compute/v2.1/os-volumes/4c5c091a-cd0c-465d-8e3c-f94f106111b2 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:25:01.691269 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:01.692024 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:01.696152 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-d95874c6-e91c-4d75-b095-e3744d773d8c tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] Calling method '.version_select at 0x7f2821f97820>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:01.805053 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-d95874c6-e91c-4d75-b095-e3744d773d8c tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/4c5c091a-cd0c-465d-8e3c-f94f106111b2" status: 200 len: 346 microversion: 2.1 time: 0.115192 Aug 09 11:25:01.805813 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 479/984] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 9 11:25:01 2022] GET /compute/v2.1/os-volumes/4c5c091a-cd0c-465d-8e3c-f94f106111b2 => generated 346 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:25:01.819897 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-dc9c9178-0308-48f1-91ab-8b266cb93b29 tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] Action: 'create', calling method: .version_select at 0x7f282204d310>, body: {"snapshot": {"volume_id": "4c5c091a-cd0c-465d-8e3c-f94f106111b2", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-692617843"}} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:25:01.970628 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:01.981127 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:02.081013 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-dc9c9178-0308-48f1-91ab-8b266cb93b29 tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] 10.222.0.27 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.266472 Aug 09 11:25:02.081977 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 506/985] 10.222.0.27 () {60 vars in 1162 bytes} [Tue Aug 9 11:25:01 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:25:02.094255 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-c796e257-a531-47ff-ba6a-9b24c4a4543f tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] Calling method '.version_select at 0x7f2821f4cee0>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:02.126516 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-c796e257-a531-47ff-ba6a-9b24c4a4543f tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/9ef59b61-9f94-4db8-aa1e-f33bafd43d16" status: 200 len: 286 microversion: 2.1 time: 0.037826 Aug 09 11:25:02.127112 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 480/986] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Aug 9 11:25:02 2022] GET /compute/v2.1/os-snapshots/9ef59b61-9f94-4db8-aa1e-f33bafd43d16 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:25:02.138294 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-19c141eb-6f58-4c90-af5b-b998b37c0b44 tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] Calling method '.version_select at 0x7f2821eeb670>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:02.169338 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-19c141eb-6f58-4c90-af5b-b998b37c0b44 tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.035079 Aug 09 11:25:02.169900 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 507/987] 10.222.0.27 () {58 vars in 1140 bytes} [Tue Aug 9 11:25:02 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:25:02.183964 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-61e50c0a-7940-4139-91ea-576522bff338 tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] Calling method '.version_select at 0x7f2821f249d0>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:02.226438 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-61e50c0a-7940-4139-91ea-576522bff338 tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/9ef59b61-9f94-4db8-aa1e-f33bafd43d16" status: 200 len: 286 microversion: 2.1 time: 0.048354 Aug 09 11:25:02.227072 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 481/988] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Aug 9 11:25:02 2022] GET /compute/v2.1/os-snapshots/9ef59b61-9f94-4db8-aa1e-f33bafd43d16 => generated 286 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:25:03.239176 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-397cbc9f-70ec-429b-9da0-5860bf67420f tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] Calling method '.version_select at 0x7f282202b0d0>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:03.269792 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-397cbc9f-70ec-429b-9da0-5860bf67420f tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/9ef59b61-9f94-4db8-aa1e-f33bafd43d16" status: 200 len: 286 microversion: 2.1 time: 0.034579 Aug 09 11:25:03.270368 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 508/989] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Aug 9 11:25:03 2022] GET /compute/v2.1/os-snapshots/9ef59b61-9f94-4db8-aa1e-f33bafd43d16 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:25:04.283170 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-147136c9-45c4-475f-8a07-132d8a355cd6 tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] Calling method '.version_select at 0x7f2821e36a60>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:04.323572 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-147136c9-45c4-475f-8a07-132d8a355cd6 tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/9ef59b61-9f94-4db8-aa1e-f33bafd43d16" status: 200 len: 286 microversion: 2.1 time: 0.044633 Aug 09 11:25:04.324133 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 482/990] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Aug 9 11:25:04 2022] GET /compute/v2.1/os-snapshots/9ef59b61-9f94-4db8-aa1e-f33bafd43d16 => generated 286 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:25:05.336892 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-d615e47e-ed92-4506-902d-86a5a2c0618f tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] Calling method '.version_select at 0x7f2821ea1c10>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:05.375274 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-d615e47e-ed92-4506-902d-86a5a2c0618f tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/9ef59b61-9f94-4db8-aa1e-f33bafd43d16" status: 200 len: 287 microversion: 2.1 time: 0.042964 Aug 09 11:25:05.376235 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 509/991] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Aug 9 11:25:05 2022] GET /compute/v2.1/os-snapshots/9ef59b61-9f94-4db8-aa1e-f33bafd43d16 => generated 287 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:25:05.389296 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-82bca587-8772-43c2-a9e0-2d6cd4e8cd90 tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] Calling method '.version_select at 0x7f2821f24a60>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:05.468740 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-82bca587-8772-43c2-a9e0-2d6cd4e8cd90 tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] 10.222.0.27 "DELETE /compute/v2.1/os-snapshots/9ef59b61-9f94-4db8-aa1e-f33bafd43d16" status: 202 len: 0 microversion: 2.1 time: 0.083364 Aug 09 11:25:05.469917 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 483/992] 10.222.0.27 () {58 vars in 1254 bytes} [Tue Aug 9 11:25:05 2022] DELETE /compute/v2.1/os-snapshots/9ef59b61-9f94-4db8-aa1e-f33bafd43d16 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:25:05.479403 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-523efc0a-5664-4301-aeb1-6aecf7044378 tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] Calling method '.version_select at 0x7f2822020ee0>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:05.514252 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-523efc0a-5664-4301-aeb1-6aecf7044378 tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/9ef59b61-9f94-4db8-aa1e-f33bafd43d16" status: 200 len: 286 microversion: 2.1 time: 0.039870 Aug 09 11:25:05.515173 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 510/993] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Aug 9 11:25:05 2022] GET /compute/v2.1/os-snapshots/9ef59b61-9f94-4db8-aa1e-f33bafd43d16 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:25:06.532669 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-a3a5f05f-279e-4389-b06d-e264e9f5de02 tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] Calling method '.version_select at 0x7f2821f4c1f0>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:06.563634 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.wsgi [None req-a3a5f05f-279e-4389-b06d-e264e9f5de02 tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] HTTP exception thrown: Snapshot 9ef59b61-9f94-4db8-aa1e-f33bafd43d16 could not be found. Aug 09 11:25:06.566228 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-a3a5f05f-279e-4389-b06d-e264e9f5de02 tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] Request method failure captured: Aug 09 11:25:06.566228 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: request: GET /compute/v2.1/os-snapshots/9ef59b61-9f94-4db8-aa1e-f33bafd43d16 HTTP/1.1 Aug 09 11:25:06.566228 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept: application/json Aug 09 11:25:06.566228 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept-Encoding: identity Aug 09 11:25:06.566228 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Connection: close Aug 09 11:25:06.566228 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Length: 0 Aug 09 11:25:06.566228 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Type: application/json Aug 09 11:25:06.566228 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Host: 10.222.0.27 Aug 09 11:25:06.566228 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Openstack-System-Scope: None Aug 09 11:25:06.566228 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: User-Agent: python-urllib3/1.26.11 Aug 09 11:25:06.566228 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Auth-Token: gAAAAABi8kQJFb9q6hNf6zOYq5qjiuxZ-SBV2Zrwofo7yaZ1qe9Kx4vi_9KFqJRdHdtqJRnnNRklXNvhSLxX2r5KA-2mIk_mgPXmj2D14FY3L69INtM3qAMMD-o8oXYaebOCH9Obxhyrwiy_0guWRrcAdpK-fqjA2a5I-i_wCDCt3N4O7aUTEKs Aug 09 11:25:06.566228 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Id: None Aug 09 11:25:06.566228 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Name: None Aug 09 11:25:06.566228 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Identity-Status: Confirmed Aug 09 11:25:06.566228 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Is-Admin-Project: True Aug 09 11:25:06.566228 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Id: default Aug 09 11:25:06.566228 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Name: Default Aug 09 11:25:06.566228 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Id: 01654f0190a14e7691d5fc9879ea4927 Aug 09 11:25:06.566228 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1023996098 Aug 09 11:25:06.566228 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Role: member,reader Aug 09 11:25:06.566228 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Roles: member,reader Aug 09 11:25:06.568431 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01654f0190a14e7691d5fc9879ea4927"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_01654f0190a14e7691d5fc9879ea4927"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/01654f0190a14e7691d5fc9879ea4927"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01654f0190a14e7691d5fc9879ea4927"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:25:06.568431 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1023996098 Aug 09 11:25:06.568431 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Id: 01654f0190a14e7691d5fc9879ea4927 Aug 09 11:25:06.568431 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1023996098 Aug 09 11:25:06.568431 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User: tempest-VolumesSnapshotsTestJSON-1023996098-project Aug 09 11:25:06.568431 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Id: default Aug 09 11:25:06.568431 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Name: Default Aug 09 11:25:06.568431 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Id: a2509289eaeb48faaa83b6eba039b5c3 Aug 09 11:25:06.568431 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1023996098-project Aug 09 11:25:06.568431 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: method: Aug 09 11:25:06.568431 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: exception: Snapshot 9ef59b61-9f94-4db8-aa1e-f33bafd43d16 could not be found. Aug 09 11:25:06.568431 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: action_args: {'id': '9ef59b61-9f94-4db8-aa1e-f33bafd43d16'} Aug 09 11:25:06.568431 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:25:06.569287 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:25:06.569287 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 09 11:25:06.569287 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 09 11:25:06.569287 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 09 11:25:06.569287 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 09 11:25:06.569287 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 09 11:25:06.569287 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 09 11:25:06.569287 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 11:25:06.569287 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 11:25:06.569287 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 11:25:06.569287 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 11:25:06.569287 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 11:25:06.569287 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 11:25:06.569287 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 11:25:06.569287 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 11:25:06.569287 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 9ef59b61-9f94-4db8-aa1e-f33bafd43d16 could not be found. (HTTP 404) (Request-ID: req-1a4cc06c-af33-43f2-a621-2edce207dbd3) Aug 09 11:25:06.569287 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:25:06.569287 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:25:06.571362 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:25:06.571362 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:25:06.571362 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 09 11:25:06.571362 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 09 11:25:06.571362 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 11:25:06.571362 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 11:25:06.571362 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 09 11:25:06.571362 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 09 11:25:06.571362 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 11:25:06.571362 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 11:25:06.571362 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 09 11:25:06.571362 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 09 11:25:06.571362 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 09 11:25:06.571362 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 09 11:25:06.571362 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 09 11:25:06.571362 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 09 11:25:06.571362 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 11:25:06.571362 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 11:25:06.571362 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 11:25:06.573217 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 11:25:06.573217 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 11:25:06.573217 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 11:25:06.573217 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 11:25:06.573217 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 11:25:06.573217 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 9ef59b61-9f94-4db8-aa1e-f33bafd43d16 could not be found. Aug 09 11:25:06.573217 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:25:06.573217 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:25:06.573217 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:25:06.573217 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:25:06.573217 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:25:06.573217 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:25:06.573217 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:25:06.573217 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:25:06.573217 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 11:25:06.573217 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 11:25:06.573217 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:25:06.573217 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:25:06.573217 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 09 11:25:06.573217 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:25:06.574852 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 9ef59b61-9f94-4db8-aa1e-f33bafd43d16 could not be found. Aug 09 11:25:06.574852 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:25:06.574852 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:25:06.574852 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:25:06.574852 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:25:06.574852 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:25:06.574852 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:25:06.574852 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:25:06.574852 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:25:06.574852 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 9ef59b61-9f94-4db8-aa1e-f33bafd43d16 could not be found. Aug 09 11:25:06.574852 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:25:06.574852 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-a3a5f05f-279e-4389-b06d-e264e9f5de02 tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] Returning 404 to user: Snapshot 9ef59b61-9f94-4db8-aa1e-f33bafd43d16 could not be found. {{(pid=117684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:25:06.574852 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-a3a5f05f-279e-4389-b06d-e264e9f5de02 tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/9ef59b61-9f94-4db8-aa1e-f33bafd43d16" status: 404 len: 111 microversion: 2.1 time: 0.040959 Aug 09 11:25:06.576198 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 484/994] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Aug 9 11:25:06 2022] GET /compute/v2.1/os-snapshots/9ef59b61-9f94-4db8-aa1e-f33bafd43d16 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:25:06.580594 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-2e3f7d73-a078-4624-8484-cfce7042d1c0 tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] Calling method '.version_select at 0x7f2821eeb820>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:06.653360 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-2e3f7d73-a078-4624-8484-cfce7042d1c0 tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/4c5c091a-cd0c-465d-8e3c-f94f106111b2" status: 202 len: 0 microversion: 2.1 time: 0.077522 Aug 09 11:25:06.657056 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 511/995] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Aug 9 11:25:06 2022] DELETE /compute/v2.1/os-volumes/4c5c091a-cd0c-465d-8e3c-f94f106111b2 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:25:06.664805 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-56351829-aeb1-4688-9b5d-1937f80c5f66 tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] Calling method '.version_select at 0x7f2821f4cee0>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:06.727222 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-56351829-aeb1-4688-9b5d-1937f80c5f66 tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/4c5c091a-cd0c-465d-8e3c-f94f106111b2" status: 200 len: 345 microversion: 2.1 time: 0.067482 Aug 09 11:25:06.729042 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 485/996] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 9 11:25:06 2022] GET /compute/v2.1/os-volumes/4c5c091a-cd0c-465d-8e3c-f94f106111b2 => generated 345 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:25:07.742232 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-c72b2e56-f51a-4bd2-9d2b-48c00e76c6a8 tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] Calling method '.version_select at 0x7f2821e2c160>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:07.773640 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.wsgi [None req-c72b2e56-f51a-4bd2-9d2b-48c00e76c6a8 tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] HTTP exception thrown: Volume 4c5c091a-cd0c-465d-8e3c-f94f106111b2 could not be found. Aug 09 11:25:07.776238 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-c72b2e56-f51a-4bd2-9d2b-48c00e76c6a8 tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] Request method failure captured: Aug 09 11:25:07.776238 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: request: GET /compute/v2.1/os-volumes/4c5c091a-cd0c-465d-8e3c-f94f106111b2 HTTP/1.1 Aug 09 11:25:07.776238 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Accept: application/json Aug 09 11:25:07.776238 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Accept-Encoding: identity Aug 09 11:25:07.776238 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Connection: close Aug 09 11:25:07.776238 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Content-Length: 0 Aug 09 11:25:07.776238 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Content-Type: application/json Aug 09 11:25:07.776238 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Host: 10.222.0.27 Aug 09 11:25:07.776238 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Openstack-System-Scope: None Aug 09 11:25:07.776238 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: User-Agent: python-urllib3/1.26.11 Aug 09 11:25:07.776238 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Auth-Token: gAAAAABi8kQJFb9q6hNf6zOYq5qjiuxZ-SBV2Zrwofo7yaZ1qe9Kx4vi_9KFqJRdHdtqJRnnNRklXNvhSLxX2r5KA-2mIk_mgPXmj2D14FY3L69INtM3qAMMD-o8oXYaebOCH9Obxhyrwiy_0guWRrcAdpK-fqjA2a5I-i_wCDCt3N4O7aUTEKs Aug 09 11:25:07.776238 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Domain-Id: None Aug 09 11:25:07.776238 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Domain-Name: None Aug 09 11:25:07.776238 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Identity-Status: Confirmed Aug 09 11:25:07.776238 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Is-Admin-Project: True Aug 09 11:25:07.776238 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Domain-Id: default Aug 09 11:25:07.776238 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Domain-Name: Default Aug 09 11:25:07.776238 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Id: 01654f0190a14e7691d5fc9879ea4927 Aug 09 11:25:07.776238 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1023996098 Aug 09 11:25:07.776238 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Role: member,reader Aug 09 11:25:07.776238 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Roles: member,reader Aug 09 11:25:07.777804 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01654f0190a14e7691d5fc9879ea4927"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_01654f0190a14e7691d5fc9879ea4927"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/01654f0190a14e7691d5fc9879ea4927"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01654f0190a14e7691d5fc9879ea4927"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:25:07.777804 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1023996098 Aug 09 11:25:07.777804 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant-Id: 01654f0190a14e7691d5fc9879ea4927 Aug 09 11:25:07.777804 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1023996098 Aug 09 11:25:07.777804 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User: tempest-VolumesSnapshotsTestJSON-1023996098-project Aug 09 11:25:07.777804 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Domain-Id: default Aug 09 11:25:07.777804 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Domain-Name: Default Aug 09 11:25:07.777804 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Id: a2509289eaeb48faaa83b6eba039b5c3 Aug 09 11:25:07.777804 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1023996098-project Aug 09 11:25:07.777804 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: method: Aug 09 11:25:07.777804 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: exception: Volume 4c5c091a-cd0c-465d-8e3c-f94f106111b2 could not be found. Aug 09 11:25:07.777804 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: action_args: {'id': '4c5c091a-cd0c-465d-8e3c-f94f106111b2'} Aug 09 11:25:07.777804 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:25:07.778773 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:25:07.778773 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 11:25:07.778773 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 11:25:07.778773 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 11:25:07.778773 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 11:25:07.778773 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 11:25:07.778773 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 11:25:07.778773 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 11:25:07.778773 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 11:25:07.778773 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 11:25:07.778773 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 11:25:07.778773 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 11:25:07.778773 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 11:25:07.778773 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 11:25:07.778773 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 11:25:07.778773 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4c5c091a-cd0c-465d-8e3c-f94f106111b2 could not be found. (HTTP 404) (Request-ID: req-a9c0991b-ab3d-4bba-8df2-14e8893e6494) Aug 09 11:25:07.778773 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:25:07.778773 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:25:07.778773 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:25:07.780063 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:25:07.780063 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 09 11:25:07.780063 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 09 11:25:07.780063 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 11:25:07.780063 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 11:25:07.780063 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 11:25:07.780063 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 11:25:07.780063 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 11:25:07.780063 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 11:25:07.780063 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 11:25:07.780063 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 11:25:07.780063 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 11:25:07.780063 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 11:25:07.780063 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 11:25:07.780063 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 11:25:07.780063 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 11:25:07.780063 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 11:25:07.780063 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 11:25:07.780063 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 11:25:07.781465 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 11:25:07.781465 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 11:25:07.781465 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 11:25:07.781465 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 11:25:07.781465 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4c5c091a-cd0c-465d-8e3c-f94f106111b2 could not be found. Aug 09 11:25:07.781465 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:25:07.781465 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:25:07.781465 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:25:07.781465 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:25:07.781465 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:25:07.781465 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:25:07.781465 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:25:07.781465 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:25:07.781465 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 11:25:07.781465 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 11:25:07.781465 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:25:07.781465 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:25:07.781465 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 09 11:25:07.781465 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:25:07.783129 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4c5c091a-cd0c-465d-8e3c-f94f106111b2 could not be found. Aug 09 11:25:07.783129 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:25:07.783129 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:25:07.783129 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:25:07.783129 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:25:07.783129 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:25:07.783129 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:25:07.783129 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:25:07.783129 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:25:07.783129 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4c5c091a-cd0c-465d-8e3c-f94f106111b2 could not be found. Aug 09 11:25:07.783129 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:25:07.783129 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-c72b2e56-f51a-4bd2-9d2b-48c00e76c6a8 tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] Returning 404 to user: Volume 4c5c091a-cd0c-465d-8e3c-f94f106111b2 could not be found. {{(pid=117685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:25:07.783129 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-c72b2e56-f51a-4bd2-9d2b-48c00e76c6a8 tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/4c5c091a-cd0c-465d-8e3c-f94f106111b2" status: 404 len: 109 microversion: 2.1 time: 0.040365 Aug 09 11:25:07.783129 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 512/997] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 9 11:25:07 2022] GET /compute/v2.1/os-volumes/4c5c091a-cd0c-465d-8e3c-f94f106111b2 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:25:07.797634 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-3035b0b7-2bfa-45fb-a87e-6213f80e2316 tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] Calling method '.version_select at 0x7f2821e36160>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:07.830581 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.wsgi [None req-3035b0b7-2bfa-45fb-a87e-6213f80e2316 tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] HTTP exception thrown: Volume 4c5c091a-cd0c-465d-8e3c-f94f106111b2 could not be found. Aug 09 11:25:07.832639 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-3035b0b7-2bfa-45fb-a87e-6213f80e2316 tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] Request method failure captured: Aug 09 11:25:07.832639 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: request: DELETE /compute/v2.1/os-volumes/4c5c091a-cd0c-465d-8e3c-f94f106111b2 HTTP/1.1 Aug 09 11:25:07.832639 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept: application/json Aug 09 11:25:07.832639 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept-Encoding: identity Aug 09 11:25:07.832639 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Connection: close Aug 09 11:25:07.832639 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Length: 0 Aug 09 11:25:07.832639 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Type: application/json Aug 09 11:25:07.832639 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Host: 10.222.0.27 Aug 09 11:25:07.832639 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Openstack-System-Scope: None Aug 09 11:25:07.832639 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: User-Agent: python-urllib3/1.26.11 Aug 09 11:25:07.832639 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Auth-Token: gAAAAABi8kQJFb9q6hNf6zOYq5qjiuxZ-SBV2Zrwofo7yaZ1qe9Kx4vi_9KFqJRdHdtqJRnnNRklXNvhSLxX2r5KA-2mIk_mgPXmj2D14FY3L69INtM3qAMMD-o8oXYaebOCH9Obxhyrwiy_0guWRrcAdpK-fqjA2a5I-i_wCDCt3N4O7aUTEKs Aug 09 11:25:07.832639 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Id: None Aug 09 11:25:07.832639 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Name: None Aug 09 11:25:07.832639 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Identity-Status: Confirmed Aug 09 11:25:07.832639 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Is-Admin-Project: True Aug 09 11:25:07.832639 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Id: default Aug 09 11:25:07.832639 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Name: Default Aug 09 11:25:07.832639 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Id: 01654f0190a14e7691d5fc9879ea4927 Aug 09 11:25:07.832639 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1023996098 Aug 09 11:25:07.832639 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Role: member,reader Aug 09 11:25:07.832639 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Roles: member,reader Aug 09 11:25:07.833988 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01654f0190a14e7691d5fc9879ea4927"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_01654f0190a14e7691d5fc9879ea4927"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/01654f0190a14e7691d5fc9879ea4927"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01654f0190a14e7691d5fc9879ea4927"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:25:07.833988 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1023996098 Aug 09 11:25:07.833988 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Id: 01654f0190a14e7691d5fc9879ea4927 Aug 09 11:25:07.833988 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1023996098 Aug 09 11:25:07.833988 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User: tempest-VolumesSnapshotsTestJSON-1023996098-project Aug 09 11:25:07.833988 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Id: default Aug 09 11:25:07.833988 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Name: Default Aug 09 11:25:07.833988 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Id: a2509289eaeb48faaa83b6eba039b5c3 Aug 09 11:25:07.833988 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1023996098-project Aug 09 11:25:07.833988 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: method: Aug 09 11:25:07.833988 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: exception: Volume 4c5c091a-cd0c-465d-8e3c-f94f106111b2 could not be found. Aug 09 11:25:07.833988 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: action_args: {'id': '4c5c091a-cd0c-465d-8e3c-f94f106111b2'} Aug 09 11:25:07.833988 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:25:07.834797 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:25:07.834797 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 11:25:07.834797 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 11:25:07.834797 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 11:25:07.834797 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 11:25:07.834797 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 11:25:07.834797 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 11:25:07.834797 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 11:25:07.834797 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 11:25:07.834797 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 11:25:07.834797 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 11:25:07.834797 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 11:25:07.834797 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 11:25:07.834797 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 11:25:07.834797 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 11:25:07.834797 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4c5c091a-cd0c-465d-8e3c-f94f106111b2 could not be found. (HTTP 404) (Request-ID: req-ba6efafb-150c-4cec-9702-fc594bf97c4d) Aug 09 11:25:07.834797 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:25:07.834797 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:25:07.834797 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:25:07.836913 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:25:07.836913 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 09 11:25:07.836913 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 09 11:25:07.836913 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 11:25:07.836913 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 11:25:07.836913 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 11:25:07.836913 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 11:25:07.836913 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 11:25:07.836913 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 11:25:07.836913 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 11:25:07.836913 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 11:25:07.836913 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 11:25:07.836913 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 11:25:07.836913 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 11:25:07.836913 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 11:25:07.836913 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 11:25:07.836913 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 11:25:07.836913 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 11:25:07.836913 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 11:25:07.839336 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 11:25:07.839336 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 11:25:07.839336 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 11:25:07.839336 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 11:25:07.839336 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4c5c091a-cd0c-465d-8e3c-f94f106111b2 could not be found. Aug 09 11:25:07.839336 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:25:07.839336 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:25:07.839336 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:25:07.839336 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:25:07.839336 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:25:07.839336 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:25:07.839336 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:25:07.839336 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:25:07.839336 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 11:25:07.839336 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 11:25:07.839336 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:25:07.839336 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:25:07.839336 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 09 11:25:07.839336 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:25:07.841735 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4c5c091a-cd0c-465d-8e3c-f94f106111b2 could not be found. Aug 09 11:25:07.841735 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:25:07.841735 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:25:07.841735 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:25:07.841735 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:25:07.841735 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:25:07.841735 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:25:07.841735 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:25:07.841735 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:25:07.841735 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4c5c091a-cd0c-465d-8e3c-f94f106111b2 could not be found. Aug 09 11:25:07.841735 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:25:07.841735 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-3035b0b7-2bfa-45fb-a87e-6213f80e2316 tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] Returning 404 to user: Volume 4c5c091a-cd0c-465d-8e3c-f94f106111b2 could not be found. {{(pid=117684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:25:07.841735 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-3035b0b7-2bfa-45fb-a87e-6213f80e2316 tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/4c5c091a-cd0c-465d-8e3c-f94f106111b2" status: 404 len: 109 microversion: 2.1 time: 0.040934 Aug 09 11:25:07.841735 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 486/998] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Aug 9 11:25:07 2022] DELETE /compute/v2.1/os-volumes/4c5c091a-cd0c-465d-8e3c-f94f106111b2 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:25:07.843660 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-38c3b528-1bca-4eaf-b7a3-88ccfdc87c50 tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] Calling method '.version_select at 0x7f2821eebc10>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:07.875269 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.wsgi [None req-38c3b528-1bca-4eaf-b7a3-88ccfdc87c50 tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] HTTP exception thrown: Volume 4c5c091a-cd0c-465d-8e3c-f94f106111b2 could not be found. Aug 09 11:25:07.877255 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-38c3b528-1bca-4eaf-b7a3-88ccfdc87c50 tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] Request method failure captured: Aug 09 11:25:07.877255 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: request: GET /compute/v2.1/os-volumes/4c5c091a-cd0c-465d-8e3c-f94f106111b2 HTTP/1.1 Aug 09 11:25:07.877255 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Accept: application/json Aug 09 11:25:07.877255 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Accept-Encoding: identity Aug 09 11:25:07.877255 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Connection: close Aug 09 11:25:07.877255 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Content-Length: 0 Aug 09 11:25:07.877255 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Content-Type: application/json Aug 09 11:25:07.877255 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Host: 10.222.0.27 Aug 09 11:25:07.877255 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Openstack-System-Scope: None Aug 09 11:25:07.877255 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: User-Agent: python-urllib3/1.26.11 Aug 09 11:25:07.877255 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Auth-Token: gAAAAABi8kQJFb9q6hNf6zOYq5qjiuxZ-SBV2Zrwofo7yaZ1qe9Kx4vi_9KFqJRdHdtqJRnnNRklXNvhSLxX2r5KA-2mIk_mgPXmj2D14FY3L69INtM3qAMMD-o8oXYaebOCH9Obxhyrwiy_0guWRrcAdpK-fqjA2a5I-i_wCDCt3N4O7aUTEKs Aug 09 11:25:07.877255 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Domain-Id: None Aug 09 11:25:07.877255 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Domain-Name: None Aug 09 11:25:07.877255 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Identity-Status: Confirmed Aug 09 11:25:07.877255 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Is-Admin-Project: True Aug 09 11:25:07.877255 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Domain-Id: default Aug 09 11:25:07.877255 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Domain-Name: Default Aug 09 11:25:07.877255 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Id: 01654f0190a14e7691d5fc9879ea4927 Aug 09 11:25:07.877255 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1023996098 Aug 09 11:25:07.877255 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Role: member,reader Aug 09 11:25:07.877255 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Roles: member,reader Aug 09 11:25:07.878811 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01654f0190a14e7691d5fc9879ea4927"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_01654f0190a14e7691d5fc9879ea4927"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/01654f0190a14e7691d5fc9879ea4927"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01654f0190a14e7691d5fc9879ea4927"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:25:07.878811 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1023996098 Aug 09 11:25:07.878811 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant-Id: 01654f0190a14e7691d5fc9879ea4927 Aug 09 11:25:07.878811 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1023996098 Aug 09 11:25:07.878811 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User: tempest-VolumesSnapshotsTestJSON-1023996098-project Aug 09 11:25:07.878811 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Domain-Id: default Aug 09 11:25:07.878811 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Domain-Name: Default Aug 09 11:25:07.878811 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Id: a2509289eaeb48faaa83b6eba039b5c3 Aug 09 11:25:07.878811 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1023996098-project Aug 09 11:25:07.878811 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: method: Aug 09 11:25:07.878811 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: exception: Volume 4c5c091a-cd0c-465d-8e3c-f94f106111b2 could not be found. Aug 09 11:25:07.878811 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: action_args: {'id': '4c5c091a-cd0c-465d-8e3c-f94f106111b2'} Aug 09 11:25:07.878811 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:25:07.879820 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:25:07.879820 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 11:25:07.879820 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 11:25:07.879820 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 11:25:07.879820 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 11:25:07.879820 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 11:25:07.879820 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 11:25:07.879820 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 11:25:07.879820 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 11:25:07.879820 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 11:25:07.879820 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 11:25:07.879820 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 11:25:07.879820 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 11:25:07.879820 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 11:25:07.879820 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 11:25:07.879820 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4c5c091a-cd0c-465d-8e3c-f94f106111b2 could not be found. (HTTP 404) (Request-ID: req-966b21ff-944a-4024-9626-16bb7a71708f) Aug 09 11:25:07.879820 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:25:07.879820 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:25:07.879820 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:25:07.881229 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:25:07.881229 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 09 11:25:07.881229 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 09 11:25:07.881229 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 11:25:07.881229 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 11:25:07.881229 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 11:25:07.881229 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 11:25:07.881229 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 11:25:07.881229 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 11:25:07.881229 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 11:25:07.881229 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 11:25:07.881229 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 11:25:07.881229 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 11:25:07.881229 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 11:25:07.881229 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 11:25:07.881229 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 11:25:07.881229 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 11:25:07.881229 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 11:25:07.881229 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 11:25:07.882336 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 11:25:07.882336 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 11:25:07.882336 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 11:25:07.882336 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 11:25:07.882336 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4c5c091a-cd0c-465d-8e3c-f94f106111b2 could not be found. Aug 09 11:25:07.882336 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:25:07.882336 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:25:07.882336 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:25:07.882336 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:25:07.882336 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:25:07.882336 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:25:07.882336 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:25:07.882336 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:25:07.882336 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 11:25:07.882336 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 11:25:07.882336 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:25:07.882336 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:25:07.882336 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 09 11:25:07.882336 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:25:07.883572 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4c5c091a-cd0c-465d-8e3c-f94f106111b2 could not be found. Aug 09 11:25:07.883572 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:25:07.883572 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:25:07.883572 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:25:07.883572 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:25:07.883572 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:25:07.883572 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:25:07.883572 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:25:07.883572 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:25:07.883572 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4c5c091a-cd0c-465d-8e3c-f94f106111b2 could not be found. Aug 09 11:25:07.883572 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:25:07.883572 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-38c3b528-1bca-4eaf-b7a3-88ccfdc87c50 tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] Returning 404 to user: Volume 4c5c091a-cd0c-465d-8e3c-f94f106111b2 could not be found. {{(pid=117685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:25:07.883572 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-38c3b528-1bca-4eaf-b7a3-88ccfdc87c50 tempest-VolumesSnapshotsTestJSON-1023996098 tempest-VolumesSnapshotsTestJSON-1023996098-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/4c5c091a-cd0c-465d-8e3c-f94f106111b2" status: 404 len: 109 microversion: 2.1 time: 0.039301 Aug 09 11:25:07.883572 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 513/999] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 9 11:25:07 2022] GET /compute/v2.1/os-volumes/4c5c091a-cd0c-465d-8e3c-f94f106111b2 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:25:14.527859 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-7575cbc4-699e-45b3-b419-72c3c3e1bd2f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:14.531427 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-7575cbc4-699e-45b3-b419-72c3c3e1bd2f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:25:14.538943 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7575cbc4-699e-45b3-b419-72c3c3e1bd2f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:14.539426 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7575cbc4-699e-45b3-b419-72c3c3e1bd2f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:14.539847 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7575cbc4-699e-45b3-b419-72c3c3e1bd2f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:14.540733 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7575cbc4-699e-45b3-b419-72c3c3e1bd2f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:14.541180 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7575cbc4-699e-45b3-b419-72c3c3e1bd2f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:14.541600 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7575cbc4-699e-45b3-b419-72c3c3e1bd2f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:14.574215 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-7575cbc4-699e-45b3-b419-72c3c3e1bd2f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051240 Aug 09 11:25:14.575424 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 487/1000] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Aug 9 11:25:14 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:25:14.652441 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-a11ac2fc-8dc0-4fb6-b51a-6c515fa13999 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:14.652995 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-a11ac2fc-8dc0-4fb6-b51a-6c515fa13999 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:25:14.658921 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a11ac2fc-8dc0-4fb6-b51a-6c515fa13999 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:14.659385 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a11ac2fc-8dc0-4fb6-b51a-6c515fa13999 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:14.659811 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a11ac2fc-8dc0-4fb6-b51a-6c515fa13999 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:14.660566 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a11ac2fc-8dc0-4fb6-b51a-6c515fa13999 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:14.661072 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a11ac2fc-8dc0-4fb6-b51a-6c515fa13999 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:14.661488 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a11ac2fc-8dc0-4fb6-b51a-6c515fa13999 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:14.689445 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-a11ac2fc-8dc0-4fb6-b51a-6c515fa13999 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Going to try to terminate instance {{(pid=117685) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 11:25:14.824875 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-a11ac2fc-8dc0-4fb6-b51a-6c515fa13999 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "DELETE /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 204 len: 0 microversion: 2.20 time: 0.177489 Aug 09 11:25:14.825507 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 514/1001] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Aug 9 11:25:14 2022] DELETE /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 11:25:14.834528 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-c2b12cb5-26a6-48a1-8680-6b3ea75b3086 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:14.835169 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-c2b12cb5-26a6-48a1-8680-6b3ea75b3086 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:25:14.841632 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c2b12cb5-26a6-48a1-8680-6b3ea75b3086 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:14.842415 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c2b12cb5-26a6-48a1-8680-6b3ea75b3086 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:14.843003 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c2b12cb5-26a6-48a1-8680-6b3ea75b3086 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:14.843879 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c2b12cb5-26a6-48a1-8680-6b3ea75b3086 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:14.844526 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c2b12cb5-26a6-48a1-8680-6b3ea75b3086 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:14.845102 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-c2b12cb5-26a6-48a1-8680-6b3ea75b3086 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:15.043129 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-c2b12cb5-26a6-48a1-8680-6b3ea75b3086 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:25:15.053640 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-c2b12cb5-26a6-48a1-8680-6b3ea75b3086 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:25:15.056178 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-c2b12cb5-26a6-48a1-8680-6b3ea75b3086 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:25:15.057999 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-c2b12cb5-26a6-48a1-8680-6b3ea75b3086 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1724 microversion: 2.20 time: 0.227803 Aug 09 11:25:15.058763 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 488/1002] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:25:14 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:25:16.083485 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-005f1390-b809-4994-ae5e-b325b37caf4d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:16.084185 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-005f1390-b809-4994-ae5e-b325b37caf4d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:25:16.090818 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-005f1390-b809-4994-ae5e-b325b37caf4d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:16.091299 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-005f1390-b809-4994-ae5e-b325b37caf4d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:16.091730 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-005f1390-b809-4994-ae5e-b325b37caf4d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:16.092464 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-005f1390-b809-4994-ae5e-b325b37caf4d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:16.092909 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-005f1390-b809-4994-ae5e-b325b37caf4d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:16.093618 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-005f1390-b809-4994-ae5e-b325b37caf4d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:16.328098 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-005f1390-b809-4994-ae5e-b325b37caf4d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:25:16.336834 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-005f1390-b809-4994-ae5e-b325b37caf4d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:25:16.338497 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-005f1390-b809-4994-ae5e-b325b37caf4d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:25:16.339850 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-005f1390-b809-4994-ae5e-b325b37caf4d tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1724 microversion: 2.20 time: 0.260926 Aug 09 11:25:16.340434 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 515/1003] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:25:16 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1724 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:25:17.365134 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-198723df-7210-456d-b502-abc93de26638 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:17.366709 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-198723df-7210-456d-b502-abc93de26638 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:25:17.377779 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-198723df-7210-456d-b502-abc93de26638 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:17.378590 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-198723df-7210-456d-b502-abc93de26638 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:17.379326 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-198723df-7210-456d-b502-abc93de26638 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:17.380474 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-198723df-7210-456d-b502-abc93de26638 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:17.384632 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-198723df-7210-456d-b502-abc93de26638 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:17.385479 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-198723df-7210-456d-b502-abc93de26638 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:17.469935 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-b9973b89-8a5d-4066-966c-4889862c308b req-7fd01ca1-afb7-4cf0-b2e0-c13c63117ee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "919c3009-894a-45e2-bc25-24df397fa3d0", "name": "network-vif-deleted", "tag": "2572315b-325e-49c1-b65d-1b98ef984660"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:25:17.493934 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-b9973b89-8a5d-4066-966c-4889862c308b req-7fd01ca1-afb7-4cf0-b2e0-c13c63117ee7 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:17.495019 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-b9973b89-8a5d-4066-966c-4889862c308b req-7fd01ca1-afb7-4cf0-b2e0-c13c63117ee7 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:17.498060 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-b9973b89-8a5d-4066-966c-4889862c308b req-7fd01ca1-afb7-4cf0-b2e0-c13c63117ee7 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:17.517871 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-198723df-7210-456d-b502-abc93de26638 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:25:17.537008 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-198723df-7210-456d-b502-abc93de26638 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:25:17.537488 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-b9973b89-8a5d-4066-966c-4889862c308b req-7fd01ca1-afb7-4cf0-b2e0-c13c63117ee7 service nova] Creating event network-vif-deleted:2572315b-325e-49c1-b65d-1b98ef984660 for instance 919c3009-894a-45e2-bc25-24df397fa3d0 on hv-cinder-85251 Aug 09 11:25:17.539545 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-198723df-7210-456d-b502-abc93de26638 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:25:17.541786 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-198723df-7210-456d-b502-abc93de26638 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1656 microversion: 2.20 time: 0.181955 Aug 09 11:25:17.547858 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-b9973b89-8a5d-4066-966c-4889862c308b req-7fd01ca1-afb7-4cf0-b2e0-c13c63117ee7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085908 Aug 09 11:25:17.549915 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 489/1004] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:25:17 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1656 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:25:17.553317 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 516/1005] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:25:18.566361 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-b5ea3e78-8eb3-4955-a44e-7e60063a36a0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:18.568833 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-b5ea3e78-8eb3-4955-a44e-7e60063a36a0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:25:18.577939 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b5ea3e78-8eb3-4955-a44e-7e60063a36a0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:18.578965 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b5ea3e78-8eb3-4955-a44e-7e60063a36a0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:18.579587 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b5ea3e78-8eb3-4955-a44e-7e60063a36a0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:18.581479 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b5ea3e78-8eb3-4955-a44e-7e60063a36a0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:18.582096 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b5ea3e78-8eb3-4955-a44e-7e60063a36a0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:18.583369 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b5ea3e78-8eb3-4955-a44e-7e60063a36a0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:18.661062 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-b5ea3e78-8eb3-4955-a44e-7e60063a36a0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:25:18.672664 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-b5ea3e78-8eb3-4955-a44e-7e60063a36a0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:25:18.678541 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-b5ea3e78-8eb3-4955-a44e-7e60063a36a0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:25:18.679924 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-b5ea3e78-8eb3-4955-a44e-7e60063a36a0 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1366 microversion: 2.20 time: 0.118524 Aug 09 11:25:18.692377 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 490/1006] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:25:18 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1366 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:25:19.705660 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-5e6e0f41-75d3-46c9-9636-797c7fdade4b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:19.706370 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-5e6e0f41-75d3-46c9-9636-797c7fdade4b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:25:19.714069 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5e6e0f41-75d3-46c9-9636-797c7fdade4b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:19.714578 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5e6e0f41-75d3-46c9-9636-797c7fdade4b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:19.715091 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5e6e0f41-75d3-46c9-9636-797c7fdade4b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:19.715870 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5e6e0f41-75d3-46c9-9636-797c7fdade4b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:19.716387 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5e6e0f41-75d3-46c9-9636-797c7fdade4b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:19.716842 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5e6e0f41-75d3-46c9-9636-797c7fdade4b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:19.749691 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5e6e0f41-75d3-46c9-9636-797c7fdade4b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:19.750172 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5e6e0f41-75d3-46c9-9636-797c7fdade4b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:19.750613 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-5e6e0f41-75d3-46c9-9636-797c7fdade4b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:19.751053 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.objects.instance [None req-5e6e0f41-75d3-46c9-9636-797c7fdade4b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lazy-loading 'fault' on Instance uuid 919c3009-894a-45e2-bc25-24df397fa3d0 {{(pid=117685) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:25:19.797063 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-5e6e0f41-75d3-46c9-9636-797c7fdade4b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:25:19.805154 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-5e6e0f41-75d3-46c9-9636-797c7fdade4b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:25:19.806635 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-5e6e0f41-75d3-46c9-9636-797c7fdade4b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6543b377f14949a6919af4e4e187b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f938fbc477f34eedb17c9ead3084a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:25:19.807785 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-5e6e0f41-75d3-46c9-9636-797c7fdade4b tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 200 len: 1371 microversion: 2.20 time: 0.106945 Aug 09 11:25:19.808404 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 517/1007] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:25:19 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 1371 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:25:20.831042 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-6604a757-e666-483c-b4f6-7e6286804d8a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:20.831853 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-6604a757-e666-483c-b4f6-7e6286804d8a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:25:20.840442 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6604a757-e666-483c-b4f6-7e6286804d8a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:20.841174 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6604a757-e666-483c-b4f6-7e6286804d8a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:20.841762 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6604a757-e666-483c-b4f6-7e6286804d8a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:20.842478 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6604a757-e666-483c-b4f6-7e6286804d8a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:20.843189 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6604a757-e666-483c-b4f6-7e6286804d8a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:20.843668 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6604a757-e666-483c-b4f6-7e6286804d8a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:20.859997 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.wsgi [None req-6604a757-e666-483c-b4f6-7e6286804d8a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] HTTP exception thrown: Instance 919c3009-894a-45e2-bc25-24df397fa3d0 could not be found. Aug 09 11:25:20.861906 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-6604a757-e666-483c-b4f6-7e6286804d8a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Request method failure captured: Aug 09 11:25:20.861906 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: request: GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 HTTP/1.1 Aug 09 11:25:20.861906 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept: application/json Aug 09 11:25:20.861906 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept-Encoding: identity Aug 09 11:25:20.861906 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Connection: close Aug 09 11:25:20.861906 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Length: 0 Aug 09 11:25:20.861906 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Type: application/json Aug 09 11:25:20.861906 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Host: 10.222.0.27 Aug 09 11:25:20.861906 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Openstack-System-Scope: None Aug 09 11:25:20.861906 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: User-Agent: python-urllib3/1.26.11 Aug 09 11:25:20.861906 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Auth-Token: gAAAAABi8kJpBpnG_KfTunZaXhc-EO5fHtNL1HlSN7oRXHqdxwDML8yRS2LJPv8qmd_BwUUYq-xXWY7UvtlBItZvGotU07WwI2ru5dt3qcvZiIAEh5lAl5czBtFgxWfLAUFXeEkh9rHMDZjbpZeDosT2C719tbtlt-9b5c0CeoyK5VMqKgV9ce4 Aug 09 11:25:20.861906 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Id: None Aug 09 11:25:20.861906 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Name: None Aug 09 11:25:20.861906 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Identity-Status: Confirmed Aug 09 11:25:20.861906 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Is-Admin-Project: True Aug 09 11:25:20.861906 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 11:25:20.861906 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Id: default Aug 09 11:25:20.861906 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Name: Default Aug 09 11:25:20.861906 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Id: f938fbc477f34eedb17c9ead3084a207 Aug 09 11:25:20.861906 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-793190908 Aug 09 11:25:20.861906 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Role: member,reader Aug 09 11:25:20.861906 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Roles: member,reader Aug 09 11:25:20.863611 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f938fbc477f34eedb17c9ead3084a207"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f938fbc477f34eedb17c9ead3084a207"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f938fbc477f34eedb17c9ead3084a207"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f938fbc477f34eedb17c9ead3084a207"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:25:20.863611 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant: tempest-AttachVolumeShelveTestJSON-793190908 Aug 09 11:25:20.863611 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Id: f938fbc477f34eedb17c9ead3084a207 Aug 09 11:25:20.863611 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-793190908 Aug 09 11:25:20.863611 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User: tempest-AttachVolumeShelveTestJSON-793190908-project Aug 09 11:25:20.863611 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Id: default Aug 09 11:25:20.863611 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Name: Default Aug 09 11:25:20.863611 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Id: 2e6543b377f14949a6919af4e4e187b7 Aug 09 11:25:20.863611 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Name: tempest-AttachVolumeShelveTestJSON-793190908-project Aug 09 11:25:20.863611 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: method: > Aug 09 11:25:20.863611 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: exception: Instance 919c3009-894a-45e2-bc25-24df397fa3d0 could not be found. Aug 09 11:25:20.863611 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: action_args: {'id': '919c3009-894a-45e2-bc25-24df397fa3d0'} Aug 09 11:25:20.864545 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:25:20.864545 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:25:20.864545 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:25:20.864545 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:25:20.864545 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:25:20.864545 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:25:20.864545 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:25:20.864545 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:25:20.864545 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:25:20.864545 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:25:20.864545 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 919c3009-894a-45e2-bc25-24df397fa3d0 could not be found. Aug 09 11:25:20.864545 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:25:20.864545 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:25:20.864545 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:25:20.864545 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:25:20.864545 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:25:20.864545 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:25:20.864545 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:25:20.864545 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:25:20.864545 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:25:20.865932 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:25:20.865932 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:25:20.865932 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:25:20.865932 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:25:20.865932 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:25:20.865932 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:25:20.865932 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:25:20.865932 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 919c3009-894a-45e2-bc25-24df397fa3d0 could not be found. Aug 09 11:25:20.865932 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:25:20.865932 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:25:20.865932 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:25:20.865932 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:25:20.865932 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:25:20.865932 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:25:20.865932 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:25:20.865932 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:25:20.865932 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 919c3009-894a-45e2-bc25-24df397fa3d0 could not be found. Aug 09 11:25:20.865932 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:25:20.868238 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-6604a757-e666-483c-b4f6-7e6286804d8a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Returning 404 to user: Instance 919c3009-894a-45e2-bc25-24df397fa3d0 could not be found. {{(pid=117684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:25:20.869310 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-6604a757-e666-483c-b4f6-7e6286804d8a tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 404 len: 111 microversion: 2.20 time: 0.042276 Aug 09 11:25:20.869835 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 491/1008] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:25:20 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 11:25:20.879496 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-e1ab7588-cb83-4738-a5e7-5beb9dd50925 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '.version_select at 0x7f28247eb310>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:20.900696 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-e1ab7588-cb83-4738-a5e7-5beb9dd50925 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-475185723" status: 204 len: 0 microversion: 2.20 time: 0.025706 Aug 09 11:25:20.901599 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 518/1009] 10.222.0.27 () {60 vars in 1259 bytes} [Tue Aug 9 11:25:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-475185723 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 11:25:22.744589 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-ef523920-278b-45a1-9cf2-badabed16e1f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:22.745130 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-ef523920-278b-45a1-9cf2-badabed16e1f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:25:22.751688 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ef523920-278b-45a1-9cf2-badabed16e1f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:22.752172 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ef523920-278b-45a1-9cf2-badabed16e1f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:22.752623 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ef523920-278b-45a1-9cf2-badabed16e1f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:22.753304 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ef523920-278b-45a1-9cf2-badabed16e1f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:22.753740 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ef523920-278b-45a1-9cf2-badabed16e1f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:22.754220 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ef523920-278b-45a1-9cf2-badabed16e1f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:22.768472 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.wsgi [None req-ef523920-278b-45a1-9cf2-badabed16e1f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] HTTP exception thrown: Instance 919c3009-894a-45e2-bc25-24df397fa3d0 could not be found. Aug 09 11:25:22.770380 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-ef523920-278b-45a1-9cf2-badabed16e1f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Request method failure captured: Aug 09 11:25:22.770380 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: request: DELETE /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 HTTP/1.1 Aug 09 11:25:22.770380 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept: application/json Aug 09 11:25:22.770380 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept-Encoding: identity Aug 09 11:25:22.770380 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Connection: close Aug 09 11:25:22.770380 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Length: 0 Aug 09 11:25:22.770380 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Type: application/json Aug 09 11:25:22.770380 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Host: 10.222.0.27 Aug 09 11:25:22.770380 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Openstack-System-Scope: None Aug 09 11:25:22.770380 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: User-Agent: python-urllib3/1.26.11 Aug 09 11:25:22.770380 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Auth-Token: gAAAAABi8kJpBpnG_KfTunZaXhc-EO5fHtNL1HlSN7oRXHqdxwDML8yRS2LJPv8qmd_BwUUYq-xXWY7UvtlBItZvGotU07WwI2ru5dt3qcvZiIAEh5lAl5czBtFgxWfLAUFXeEkh9rHMDZjbpZeDosT2C719tbtlt-9b5c0CeoyK5VMqKgV9ce4 Aug 09 11:25:22.770380 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Id: None Aug 09 11:25:22.770380 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Name: None Aug 09 11:25:22.770380 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Identity-Status: Confirmed Aug 09 11:25:22.770380 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Is-Admin-Project: True Aug 09 11:25:22.770380 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 11:25:22.770380 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Id: default Aug 09 11:25:22.770380 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Name: Default Aug 09 11:25:22.770380 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Id: f938fbc477f34eedb17c9ead3084a207 Aug 09 11:25:22.770380 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-793190908 Aug 09 11:25:22.770380 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Role: member,reader Aug 09 11:25:22.770380 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Roles: member,reader Aug 09 11:25:22.772026 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f938fbc477f34eedb17c9ead3084a207"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f938fbc477f34eedb17c9ead3084a207"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f938fbc477f34eedb17c9ead3084a207"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f938fbc477f34eedb17c9ead3084a207"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:25:22.772026 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant: tempest-AttachVolumeShelveTestJSON-793190908 Aug 09 11:25:22.772026 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Id: f938fbc477f34eedb17c9ead3084a207 Aug 09 11:25:22.772026 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-793190908 Aug 09 11:25:22.772026 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User: tempest-AttachVolumeShelveTestJSON-793190908-project Aug 09 11:25:22.772026 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Id: default Aug 09 11:25:22.772026 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Name: Default Aug 09 11:25:22.772026 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Id: 2e6543b377f14949a6919af4e4e187b7 Aug 09 11:25:22.772026 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Name: tempest-AttachVolumeShelveTestJSON-793190908-project Aug 09 11:25:22.772026 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: method: > Aug 09 11:25:22.772026 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: exception: Instance 919c3009-894a-45e2-bc25-24df397fa3d0 could not be found. Aug 09 11:25:22.772026 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: action_args: {'id': '919c3009-894a-45e2-bc25-24df397fa3d0'} Aug 09 11:25:22.773376 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:25:22.773376 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:25:22.773376 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:25:22.773376 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:25:22.773376 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:25:22.773376 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:25:22.773376 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:25:22.773376 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:25:22.773376 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:25:22.773376 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:25:22.773376 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 919c3009-894a-45e2-bc25-24df397fa3d0 could not be found. Aug 09 11:25:22.773376 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:25:22.773376 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:25:22.773376 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:25:22.773376 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:25:22.773376 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:25:22.773376 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:25:22.773376 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:25:22.773376 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:25:22.773376 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:25:22.774803 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:25:22.774803 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 11:25:22.774803 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 11:25:22.774803 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 11:25:22.774803 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 11:25:22.774803 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:25:22.774803 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:25:22.774803 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:25:22.774803 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:25:22.774803 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 919c3009-894a-45e2-bc25-24df397fa3d0 could not be found. Aug 09 11:25:22.774803 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:25:22.774803 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:25:22.774803 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:25:22.774803 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:25:22.774803 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:25:22.774803 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:25:22.774803 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:25:22.774803 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:25:22.774803 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 919c3009-894a-45e2-bc25-24df397fa3d0 could not be found. Aug 09 11:25:22.774803 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:25:22.776248 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-ef523920-278b-45a1-9cf2-badabed16e1f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Returning 404 to user: Instance 919c3009-894a-45e2-bc25-24df397fa3d0 could not be found. {{(pid=117684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:25:22.776248 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-ef523920-278b-45a1-9cf2-badabed16e1f tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "DELETE /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 404 len: 111 microversion: 2.20 time: 0.031431 Aug 09 11:25:22.776909 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 492/1010] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Aug 9 11:25:22 2022] DELETE /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 09 11:25:22.782965 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-6227e18d-e4fb-4c13-b08f-2d2f7732cfee tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:22.783692 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-6227e18d-e4fb-4c13-b08f-2d2f7732cfee tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 919c3009-894a-45e2-bc25-24df397fa3d0] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:25:22.794174 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6227e18d-e4fb-4c13-b08f-2d2f7732cfee tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:22.794669 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6227e18d-e4fb-4c13-b08f-2d2f7732cfee tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:22.795095 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6227e18d-e4fb-4c13-b08f-2d2f7732cfee tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:22.795800 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6227e18d-e4fb-4c13-b08f-2d2f7732cfee tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:22.796246 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6227e18d-e4fb-4c13-b08f-2d2f7732cfee tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:22.796739 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6227e18d-e4fb-4c13-b08f-2d2f7732cfee tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:22.810602 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.wsgi [None req-6227e18d-e4fb-4c13-b08f-2d2f7732cfee tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] HTTP exception thrown: Instance 919c3009-894a-45e2-bc25-24df397fa3d0 could not be found. Aug 09 11:25:22.812307 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-6227e18d-e4fb-4c13-b08f-2d2f7732cfee tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Request method failure captured: Aug 09 11:25:22.812307 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: request: GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 HTTP/1.1 Aug 09 11:25:22.812307 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Accept: application/json Aug 09 11:25:22.812307 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Accept-Encoding: identity Aug 09 11:25:22.812307 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Connection: close Aug 09 11:25:22.812307 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Content-Length: 0 Aug 09 11:25:22.812307 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Content-Type: application/json Aug 09 11:25:22.812307 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Host: 10.222.0.27 Aug 09 11:25:22.812307 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Openstack-System-Scope: None Aug 09 11:25:22.812307 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: User-Agent: python-urllib3/1.26.11 Aug 09 11:25:22.812307 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Auth-Token: gAAAAABi8kJpBpnG_KfTunZaXhc-EO5fHtNL1HlSN7oRXHqdxwDML8yRS2LJPv8qmd_BwUUYq-xXWY7UvtlBItZvGotU07WwI2ru5dt3qcvZiIAEh5lAl5czBtFgxWfLAUFXeEkh9rHMDZjbpZeDosT2C719tbtlt-9b5c0CeoyK5VMqKgV9ce4 Aug 09 11:25:22.812307 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Domain-Id: None Aug 09 11:25:22.812307 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Domain-Name: None Aug 09 11:25:22.812307 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Identity-Status: Confirmed Aug 09 11:25:22.812307 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Is-Admin-Project: True Aug 09 11:25:22.812307 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 11:25:22.812307 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Domain-Id: default Aug 09 11:25:22.812307 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Domain-Name: Default Aug 09 11:25:22.812307 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Id: f938fbc477f34eedb17c9ead3084a207 Aug 09 11:25:22.812307 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-793190908 Aug 09 11:25:22.812307 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Role: member,reader Aug 09 11:25:22.812307 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Roles: member,reader Aug 09 11:25:22.813918 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f938fbc477f34eedb17c9ead3084a207"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f938fbc477f34eedb17c9ead3084a207"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f938fbc477f34eedb17c9ead3084a207"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f938fbc477f34eedb17c9ead3084a207"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:25:22.813918 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant: tempest-AttachVolumeShelveTestJSON-793190908 Aug 09 11:25:22.813918 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant-Id: f938fbc477f34eedb17c9ead3084a207 Aug 09 11:25:22.813918 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-793190908 Aug 09 11:25:22.813918 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User: tempest-AttachVolumeShelveTestJSON-793190908-project Aug 09 11:25:22.813918 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Domain-Id: default Aug 09 11:25:22.813918 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Domain-Name: Default Aug 09 11:25:22.813918 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Id: 2e6543b377f14949a6919af4e4e187b7 Aug 09 11:25:22.813918 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Name: tempest-AttachVolumeShelveTestJSON-793190908-project Aug 09 11:25:22.813918 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: method: > Aug 09 11:25:22.813918 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: exception: Instance 919c3009-894a-45e2-bc25-24df397fa3d0 could not be found. Aug 09 11:25:22.813918 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: action_args: {'id': '919c3009-894a-45e2-bc25-24df397fa3d0'} Aug 09 11:25:22.817928 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:25:22.817928 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:25:22.817928 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:25:22.817928 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:25:22.817928 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:25:22.817928 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:25:22.817928 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:25:22.817928 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:25:22.817928 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:25:22.817928 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:25:22.817928 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 919c3009-894a-45e2-bc25-24df397fa3d0 could not be found. Aug 09 11:25:22.817928 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:25:22.817928 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:25:22.817928 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:25:22.817928 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:25:22.817928 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:25:22.817928 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:25:22.817928 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:25:22.817928 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:25:22.817928 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:25:22.819330 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:25:22.819330 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:25:22.819330 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:25:22.819330 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:25:22.819330 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:25:22.819330 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:25:22.819330 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:25:22.819330 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 919c3009-894a-45e2-bc25-24df397fa3d0 could not be found. Aug 09 11:25:22.819330 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:25:22.819330 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:25:22.819330 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:25:22.819330 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:25:22.819330 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:25:22.819330 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:25:22.819330 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:25:22.819330 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:25:22.819330 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 919c3009-894a-45e2-bc25-24df397fa3d0 could not be found. Aug 09 11:25:22.819330 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:25:22.820824 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-6227e18d-e4fb-4c13-b08f-2d2f7732cfee tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Returning 404 to user: Instance 919c3009-894a-45e2-bc25-24df397fa3d0 could not be found. {{(pid=117685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:25:22.820824 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-6227e18d-e4fb-4c13-b08f-2d2f7732cfee tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0" status: 404 len: 111 microversion: 2.20 time: 0.035547 Aug 09 11:25:22.820824 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 519/1011] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:25:22 2022] GET /compute/v2.1/servers/919c3009-894a-45e2-bc25-24df397fa3d0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 11:25:23.475397 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-92f9496e-fc4a-42e4-8e7d-48ee8cd43b7a tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:23.476059 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-92f9496e-fc4a-42e4-8e7d-48ee8cd43b7a tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:25:23.476700 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-d0b3b7b7-07ad-45a3-9620-7f1387c27ea1 req-9f509cca-5159-41cc-a2b2-68e19c36b119 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b683e1f9-1d37-46d4-a7a1-9f15b514336e", "tag": "afc665af-24eb-4ff3-8263-bd971e0a7488"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:25:23.482243 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-92f9496e-fc4a-42e4-8e7d-48ee8cd43b7a tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:23.482725 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-92f9496e-fc4a-42e4-8e7d-48ee8cd43b7a tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:23.483149 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-92f9496e-fc4a-42e4-8e7d-48ee8cd43b7a tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:23.484069 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-92f9496e-fc4a-42e4-8e7d-48ee8cd43b7a tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:23.484547 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-92f9496e-fc4a-42e4-8e7d-48ee8cd43b7a tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:23.484963 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-92f9496e-fc4a-42e4-8e7d-48ee8cd43b7a tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:23.488788 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-d0b3b7b7-07ad-45a3-9620-7f1387c27ea1 req-9f509cca-5159-41cc-a2b2-68e19c36b119 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:23.495919 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-d0b3b7b7-07ad-45a3-9620-7f1387c27ea1 req-9f509cca-5159-41cc-a2b2-68e19c36b119 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:23.496537 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-d0b3b7b7-07ad-45a3-9620-7f1387c27ea1 req-9f509cca-5159-41cc-a2b2-68e19c36b119 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:23.516610 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-92f9496e-fc4a-42e4-8e7d-48ee8cd43b7a tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Going to try to terminate instance {{(pid=117684) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 11:25:23.526432 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-d0b3b7b7-07ad-45a3-9620-7f1387c27ea1 req-9f509cca-5159-41cc-a2b2-68e19c36b119 service nova] Creating event network-changed:afc665af-24eb-4ff3-8263-bd971e0a7488 for instance b683e1f9-1d37-46d4-a7a1-9f15b514336e on hv-cinder-85251 Aug 09 11:25:23.534246 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-d0b3b7b7-07ad-45a3-9620-7f1387c27ea1 req-9f509cca-5159-41cc-a2b2-68e19c36b119 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061410 Aug 09 11:25:23.537078 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 520/1012] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:25:23.646534 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-92f9496e-fc4a-42e4-8e7d-48ee8cd43b7a tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 204 len: 0 microversion: 2.1 time: 0.176165 Aug 09 11:25:23.647467 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 493/1013] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 9 11:25:23 2022] DELETE /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 11:25:23.658599 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-42486ae7-8205-4bc8-be9c-7278af27f9e4 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:23.659468 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-42486ae7-8205-4bc8-be9c-7278af27f9e4 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:25:23.667458 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-42486ae7-8205-4bc8-be9c-7278af27f9e4 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:23.668098 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-42486ae7-8205-4bc8-be9c-7278af27f9e4 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:23.669694 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-42486ae7-8205-4bc8-be9c-7278af27f9e4 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:23.670204 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-42486ae7-8205-4bc8-be9c-7278af27f9e4 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:23.670792 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-42486ae7-8205-4bc8-be9c-7278af27f9e4 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:23.671481 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-42486ae7-8205-4bc8-be9c-7278af27f9e4 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:23.998931 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-b137cf32-b1fb-4e63-8608-94a40ad791a1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:23.999500 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-b137cf32-b1fb-4e63-8608-94a40ad791a1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:25:24.012979 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b137cf32-b1fb-4e63-8608-94a40ad791a1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:24.013759 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b137cf32-b1fb-4e63-8608-94a40ad791a1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:24.014385 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b137cf32-b1fb-4e63-8608-94a40ad791a1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:24.015392 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b137cf32-b1fb-4e63-8608-94a40ad791a1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:24.016149 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b137cf32-b1fb-4e63-8608-94a40ad791a1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:24.016814 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-b137cf32-b1fb-4e63-8608-94a40ad791a1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:24.034452 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.wsgi [None req-b137cf32-b1fb-4e63-8608-94a40ad791a1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] HTTP exception thrown: Instance 69542c8c-90b6-49a4-aed3-c229168f215f could not be found. Aug 09 11:25:24.036969 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-b137cf32-b1fb-4e63-8608-94a40ad791a1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Request method failure captured: Aug 09 11:25:24.036969 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: request: DELETE /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f HTTP/1.1 Aug 09 11:25:24.036969 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept: application/json Aug 09 11:25:24.036969 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept-Encoding: identity Aug 09 11:25:24.036969 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Connection: close Aug 09 11:25:24.036969 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Length: 0 Aug 09 11:25:24.036969 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Type: application/json Aug 09 11:25:24.036969 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Host: 10.222.0.27 Aug 09 11:25:24.036969 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Openstack-System-Scope: None Aug 09 11:25:24.036969 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: User-Agent: python-urllib3/1.26.11 Aug 09 11:25:24.036969 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Auth-Token: gAAAAABi8kJpBpnG_KfTunZaXhc-EO5fHtNL1HlSN7oRXHqdxwDML8yRS2LJPv8qmd_BwUUYq-xXWY7UvtlBItZvGotU07WwI2ru5dt3qcvZiIAEh5lAl5czBtFgxWfLAUFXeEkh9rHMDZjbpZeDosT2C719tbtlt-9b5c0CeoyK5VMqKgV9ce4 Aug 09 11:25:24.036969 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Id: None Aug 09 11:25:24.036969 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Name: None Aug 09 11:25:24.036969 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Identity-Status: Confirmed Aug 09 11:25:24.036969 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Is-Admin-Project: True Aug 09 11:25:24.036969 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 11:25:24.036969 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Id: default Aug 09 11:25:24.036969 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Name: Default Aug 09 11:25:24.036969 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Id: f938fbc477f34eedb17c9ead3084a207 Aug 09 11:25:24.036969 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-793190908 Aug 09 11:25:24.036969 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Role: member,reader Aug 09 11:25:24.036969 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Roles: member,reader Aug 09 11:25:24.038728 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f938fbc477f34eedb17c9ead3084a207"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f938fbc477f34eedb17c9ead3084a207"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f938fbc477f34eedb17c9ead3084a207"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f938fbc477f34eedb17c9ead3084a207"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:25:24.038728 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant: tempest-AttachVolumeShelveTestJSON-793190908 Aug 09 11:25:24.038728 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Id: f938fbc477f34eedb17c9ead3084a207 Aug 09 11:25:24.038728 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-793190908 Aug 09 11:25:24.038728 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User: tempest-AttachVolumeShelveTestJSON-793190908-project Aug 09 11:25:24.038728 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Id: default Aug 09 11:25:24.038728 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Name: Default Aug 09 11:25:24.038728 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Id: 2e6543b377f14949a6919af4e4e187b7 Aug 09 11:25:24.038728 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Name: tempest-AttachVolumeShelveTestJSON-793190908-project Aug 09 11:25:24.038728 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: method: > Aug 09 11:25:24.038728 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: exception: Instance 69542c8c-90b6-49a4-aed3-c229168f215f could not be found. Aug 09 11:25:24.038728 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: action_args: {'id': '69542c8c-90b6-49a4-aed3-c229168f215f'} Aug 09 11:25:24.039503 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:25:24.039503 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:25:24.039503 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:25:24.039503 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:25:24.039503 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:25:24.039503 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:25:24.039503 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:25:24.039503 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:25:24.039503 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:25:24.039503 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:25:24.039503 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69542c8c-90b6-49a4-aed3-c229168f215f could not be found. Aug 09 11:25:24.039503 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:25:24.039503 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:25:24.039503 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:25:24.039503 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:25:24.039503 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:25:24.039503 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:25:24.039503 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:25:24.039503 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:25:24.039503 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:25:24.041521 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:25:24.041521 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 11:25:24.041521 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 11:25:24.041521 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 11:25:24.041521 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 11:25:24.041521 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:25:24.041521 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:25:24.041521 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:25:24.041521 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:25:24.041521 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69542c8c-90b6-49a4-aed3-c229168f215f could not be found. Aug 09 11:25:24.041521 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:25:24.041521 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:25:24.041521 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:25:24.041521 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:25:24.041521 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:25:24.041521 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:25:24.041521 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:25:24.041521 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:25:24.041521 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69542c8c-90b6-49a4-aed3-c229168f215f could not be found. Aug 09 11:25:24.041521 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:25:24.044385 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-b137cf32-b1fb-4e63-8608-94a40ad791a1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Returning 404 to user: Instance 69542c8c-90b6-49a4-aed3-c229168f215f could not be found. {{(pid=117684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:25:24.045733 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-b137cf32-b1fb-4e63-8608-94a40ad791a1 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "DELETE /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 404 len: 111 microversion: 2.20 time: 0.051019 Aug 09 11:25:24.046626 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 494/1014] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Aug 9 11:25:23 2022] DELETE /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 11:25:24.057599 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-14221a98-2079-4ddf-b7df-12cd9cb76320 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:24.058411 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-14221a98-2079-4ddf-b7df-12cd9cb76320 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] [instance: 69542c8c-90b6-49a4-aed3-c229168f215f] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:25:24.064896 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-14221a98-2079-4ddf-b7df-12cd9cb76320 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:24.065704 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-14221a98-2079-4ddf-b7df-12cd9cb76320 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:24.066244 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-14221a98-2079-4ddf-b7df-12cd9cb76320 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:24.067529 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-14221a98-2079-4ddf-b7df-12cd9cb76320 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:24.068212 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-14221a98-2079-4ddf-b7df-12cd9cb76320 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:24.069013 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-14221a98-2079-4ddf-b7df-12cd9cb76320 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:24.084995 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.wsgi [None req-14221a98-2079-4ddf-b7df-12cd9cb76320 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] HTTP exception thrown: Instance 69542c8c-90b6-49a4-aed3-c229168f215f could not be found. Aug 09 11:25:24.086845 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-14221a98-2079-4ddf-b7df-12cd9cb76320 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Request method failure captured: Aug 09 11:25:24.086845 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: request: GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f HTTP/1.1 Aug 09 11:25:24.086845 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept: application/json Aug 09 11:25:24.086845 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept-Encoding: identity Aug 09 11:25:24.086845 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Connection: close Aug 09 11:25:24.086845 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Length: 0 Aug 09 11:25:24.086845 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Type: application/json Aug 09 11:25:24.086845 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Host: 10.222.0.27 Aug 09 11:25:24.086845 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Openstack-System-Scope: None Aug 09 11:25:24.086845 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: User-Agent: python-urllib3/1.26.11 Aug 09 11:25:24.086845 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Auth-Token: gAAAAABi8kJpBpnG_KfTunZaXhc-EO5fHtNL1HlSN7oRXHqdxwDML8yRS2LJPv8qmd_BwUUYq-xXWY7UvtlBItZvGotU07WwI2ru5dt3qcvZiIAEh5lAl5czBtFgxWfLAUFXeEkh9rHMDZjbpZeDosT2C719tbtlt-9b5c0CeoyK5VMqKgV9ce4 Aug 09 11:25:24.086845 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Id: None Aug 09 11:25:24.086845 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Name: None Aug 09 11:25:24.086845 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Identity-Status: Confirmed Aug 09 11:25:24.086845 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Is-Admin-Project: True Aug 09 11:25:24.086845 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 11:25:24.086845 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Id: default Aug 09 11:25:24.086845 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Name: Default Aug 09 11:25:24.086845 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Id: f938fbc477f34eedb17c9ead3084a207 Aug 09 11:25:24.086845 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-793190908 Aug 09 11:25:24.086845 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Role: member,reader Aug 09 11:25:24.086845 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Roles: member,reader Aug 09 11:25:24.088593 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f938fbc477f34eedb17c9ead3084a207"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f938fbc477f34eedb17c9ead3084a207"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f938fbc477f34eedb17c9ead3084a207"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f938fbc477f34eedb17c9ead3084a207"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:25:24.088593 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant: tempest-AttachVolumeShelveTestJSON-793190908 Aug 09 11:25:24.088593 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Id: f938fbc477f34eedb17c9ead3084a207 Aug 09 11:25:24.088593 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-793190908 Aug 09 11:25:24.088593 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User: tempest-AttachVolumeShelveTestJSON-793190908-project Aug 09 11:25:24.088593 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Id: default Aug 09 11:25:24.088593 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Name: Default Aug 09 11:25:24.088593 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Id: 2e6543b377f14949a6919af4e4e187b7 Aug 09 11:25:24.088593 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Name: tempest-AttachVolumeShelveTestJSON-793190908-project Aug 09 11:25:24.088593 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: method: > Aug 09 11:25:24.088593 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: exception: Instance 69542c8c-90b6-49a4-aed3-c229168f215f could not be found. Aug 09 11:25:24.088593 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: action_args: {'id': '69542c8c-90b6-49a4-aed3-c229168f215f'} Aug 09 11:25:24.089531 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:25:24.089531 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:25:24.089531 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:25:24.089531 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:25:24.089531 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:25:24.089531 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:25:24.089531 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:25:24.089531 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:25:24.089531 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:25:24.089531 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:25:24.089531 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69542c8c-90b6-49a4-aed3-c229168f215f could not be found. Aug 09 11:25:24.089531 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:25:24.089531 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:25:24.089531 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:25:24.089531 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:25:24.089531 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:25:24.089531 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:25:24.089531 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:25:24.089531 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:25:24.089531 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:25:24.091075 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:25:24.091075 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:25:24.091075 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:25:24.091075 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:25:24.091075 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:25:24.091075 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:25:24.091075 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:25:24.091075 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69542c8c-90b6-49a4-aed3-c229168f215f could not be found. Aug 09 11:25:24.091075 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:25:24.091075 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:25:24.091075 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:25:24.091075 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:25:24.091075 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:25:24.091075 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:25:24.091075 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:25:24.091075 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:25:24.091075 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69542c8c-90b6-49a4-aed3-c229168f215f could not be found. Aug 09 11:25:24.091075 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:25:24.093461 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-14221a98-2079-4ddf-b7df-12cd9cb76320 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] Returning 404 to user: Instance 69542c8c-90b6-49a4-aed3-c229168f215f could not be found. {{(pid=117684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:25:24.096658 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-14221a98-2079-4ddf-b7df-12cd9cb76320 tempest-AttachVolumeShelveTestJSON-793190908 tempest-AttachVolumeShelveTestJSON-793190908-project] 10.222.0.27 "GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f" status: 404 len: 111 microversion: 2.20 time: 0.043002 Aug 09 11:25:24.097258 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 495/1015] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 9 11:25:24 2022] GET /compute/v2.1/servers/69542c8c-90b6-49a4-aed3-c229168f215f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 11:25:24.107390 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-42486ae7-8205-4bc8-be9c-7278af27f9e4 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:25:24.116899 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-42486ae7-8205-4bc8-be9c-7278af27f9e4 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1570 microversion: 2.1 time: 0.463647 Aug 09 11:25:24.117430 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 521/1016] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:25:23 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1570 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:25:25.139623 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-ab1998e1-1935-4cb0-8943-f07ffd895605 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:25.140235 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-ab1998e1-1935-4cb0-8943-f07ffd895605 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:25:25.154415 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ab1998e1-1935-4cb0-8943-f07ffd895605 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:25.154901 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ab1998e1-1935-4cb0-8943-f07ffd895605 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:25.155503 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ab1998e1-1935-4cb0-8943-f07ffd895605 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:25.156418 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ab1998e1-1935-4cb0-8943-f07ffd895605 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:25.159012 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ab1998e1-1935-4cb0-8943-f07ffd895605 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:25.159614 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ab1998e1-1935-4cb0-8943-f07ffd895605 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:25.525988 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-ab1998e1-1935-4cb0-8943-f07ffd895605 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:25:25.539384 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-ab1998e1-1935-4cb0-8943-f07ffd895605 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1570 microversion: 2.1 time: 0.404487 Aug 09 11:25:25.542015 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 496/1017] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:25:25 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1570 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:25:25.743357 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-88d70225-29f3-4411-8a4e-febcc57ff288 req-7842f706-6409-4b82-b107-749eba16ecc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b683e1f9-1d37-46d4-a7a1-9f15b514336e", "name": "network-vif-deleted", "tag": "afc665af-24eb-4ff3-8263-bd971e0a7488"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:25:25.756619 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-88d70225-29f3-4411-8a4e-febcc57ff288 req-7842f706-6409-4b82-b107-749eba16ecc4 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:25.757910 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-88d70225-29f3-4411-8a4e-febcc57ff288 req-7842f706-6409-4b82-b107-749eba16ecc4 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:25.758281 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-88d70225-29f3-4411-8a4e-febcc57ff288 req-7842f706-6409-4b82-b107-749eba16ecc4 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:25.777342 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-88d70225-29f3-4411-8a4e-febcc57ff288 req-7842f706-6409-4b82-b107-749eba16ecc4 service nova] Creating event network-vif-deleted:afc665af-24eb-4ff3-8263-bd971e0a7488 for instance b683e1f9-1d37-46d4-a7a1-9f15b514336e on hv-cinder-85251 Aug 09 11:25:25.789374 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-88d70225-29f3-4411-8a4e-febcc57ff288 req-7842f706-6409-4b82-b107-749eba16ecc4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052008 Aug 09 11:25:25.790806 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 522/1018] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:25:26.567110 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-7c848409-6d7d-4cc7-847c-9bdbabd72f91 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:26.567967 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-7c848409-6d7d-4cc7-847c-9bdbabd72f91 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:25:26.583725 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7c848409-6d7d-4cc7-847c-9bdbabd72f91 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:26.584232 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7c848409-6d7d-4cc7-847c-9bdbabd72f91 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:26.584701 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7c848409-6d7d-4cc7-847c-9bdbabd72f91 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:26.585399 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7c848409-6d7d-4cc7-847c-9bdbabd72f91 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:26.585921 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7c848409-6d7d-4cc7-847c-9bdbabd72f91 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:26.586329 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7c848409-6d7d-4cc7-847c-9bdbabd72f91 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:26.689607 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7c848409-6d7d-4cc7-847c-9bdbabd72f91 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:26.690353 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7c848409-6d7d-4cc7-847c-9bdbabd72f91 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:26.691070 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7c848409-6d7d-4cc7-847c-9bdbabd72f91 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:26.691779 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.objects.instance [None req-7c848409-6d7d-4cc7-847c-9bdbabd72f91 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lazy-loading 'fault' on Instance uuid b683e1f9-1d37-46d4-a7a1-9f15b514336e {{(pid=117684) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:25:26.766109 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-7c848409-6d7d-4cc7-847c-9bdbabd72f91 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb97bc956b14342990b1dd5d8c7be95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c49e74c4e4767b872c300ac829345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:25:26.789954 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-7c848409-6d7d-4cc7-847c-9bdbabd72f91 tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 200 len: 1342 microversion: 2.1 time: 0.226944 Aug 09 11:25:26.790888 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 497/1019] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:25:26 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 1342 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:25:27.818520 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-61e2fb05-e57b-45ed-b753-8b0535136e7f tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:27.819226 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-61e2fb05-e57b-45ed-b753-8b0535136e7f tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] [instance: b683e1f9-1d37-46d4-a7a1-9f15b514336e] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:25:27.830020 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-61e2fb05-e57b-45ed-b753-8b0535136e7f tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:27.830512 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-61e2fb05-e57b-45ed-b753-8b0535136e7f tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:27.830931 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-61e2fb05-e57b-45ed-b753-8b0535136e7f tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:27.838397 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-61e2fb05-e57b-45ed-b753-8b0535136e7f tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:27.840360 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-61e2fb05-e57b-45ed-b753-8b0535136e7f tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:27.840901 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-61e2fb05-e57b-45ed-b753-8b0535136e7f tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:27.865569 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.wsgi [None req-61e2fb05-e57b-45ed-b753-8b0535136e7f tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] HTTP exception thrown: Instance b683e1f9-1d37-46d4-a7a1-9f15b514336e could not be found. Aug 09 11:25:27.869127 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-61e2fb05-e57b-45ed-b753-8b0535136e7f tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Request method failure captured: Aug 09 11:25:27.869127 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: request: GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e HTTP/1.1 Aug 09 11:25:27.869127 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Accept: application/json Aug 09 11:25:27.869127 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Accept-Encoding: identity Aug 09 11:25:27.869127 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Connection: close Aug 09 11:25:27.869127 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Content-Length: 0 Aug 09 11:25:27.869127 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Content-Type: application/json Aug 09 11:25:27.869127 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Host: 10.222.0.27 Aug 09 11:25:27.869127 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Openstack-System-Scope: None Aug 09 11:25:27.869127 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: User-Agent: python-urllib3/1.26.11 Aug 09 11:25:27.869127 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Auth-Token: gAAAAABi8kLGdxC4SCoJJcH1ngqMqPbtXvXHYiosGhQaDcVhLKJLEut9aqp0Baa5mIRP2t4kmRh80c0y1dTfpMHOIK0rjokDbxbN__N2wUTHsv9_xbQmwAa4tXRge99a_F5XVhIUnm9XQl9O1oIq9_rfc09z2OqemKWgYbGVjGHJOHOXoQVJnWE Aug 09 11:25:27.869127 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Domain-Id: None Aug 09 11:25:27.869127 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Domain-Name: None Aug 09 11:25:27.869127 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Identity-Status: Confirmed Aug 09 11:25:27.869127 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Is-Admin-Project: True Aug 09 11:25:27.869127 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Domain-Id: default Aug 09 11:25:27.869127 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Domain-Name: Default Aug 09 11:25:27.869127 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Id: 821c49e74c4e4767b872c300ac829345 Aug 09 11:25:27.869127 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Name: tempest-TestShelveInstance-1694314947 Aug 09 11:25:27.869127 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Role: member,reader Aug 09 11:25:27.869127 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Roles: member,reader Aug 09 11:25:27.870855 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/821c49e74c4e4767b872c300ac829345"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_821c49e74c4e4767b872c300ac829345"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/821c49e74c4e4767b872c300ac829345"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/821c49e74c4e4767b872c300ac829345"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:25:27.870855 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant: tempest-TestShelveInstance-1694314947 Aug 09 11:25:27.870855 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant-Id: 821c49e74c4e4767b872c300ac829345 Aug 09 11:25:27.870855 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant-Name: tempest-TestShelveInstance-1694314947 Aug 09 11:25:27.870855 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User: tempest-TestShelveInstance-1694314947-project Aug 09 11:25:27.870855 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Domain-Id: default Aug 09 11:25:27.870855 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Domain-Name: Default Aug 09 11:25:27.870855 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Id: 0fb97bc956b14342990b1dd5d8c7be95 Aug 09 11:25:27.870855 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Name: tempest-TestShelveInstance-1694314947-project Aug 09 11:25:27.870855 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: method: > Aug 09 11:25:27.870855 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: exception: Instance b683e1f9-1d37-46d4-a7a1-9f15b514336e could not be found. Aug 09 11:25:27.870855 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: action_args: {'id': 'b683e1f9-1d37-46d4-a7a1-9f15b514336e'} Aug 09 11:25:27.871722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:25:27.871722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:25:27.871722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:25:27.871722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:25:27.871722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:25:27.871722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:25:27.871722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:25:27.871722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:25:27.871722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:25:27.871722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:25:27.871722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b683e1f9-1d37-46d4-a7a1-9f15b514336e could not be found. Aug 09 11:25:27.871722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:25:27.871722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:25:27.871722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:25:27.871722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:25:27.871722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:25:27.871722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:25:27.871722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:25:27.871722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:25:27.871722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:25:27.872997 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:25:27.872997 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:25:27.872997 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:25:27.872997 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:25:27.872997 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:25:27.872997 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:25:27.872997 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:25:27.872997 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b683e1f9-1d37-46d4-a7a1-9f15b514336e could not be found. Aug 09 11:25:27.872997 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:25:27.872997 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:25:27.872997 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:25:27.872997 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:25:27.872997 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:25:27.872997 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:25:27.872997 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:25:27.872997 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:25:27.872997 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b683e1f9-1d37-46d4-a7a1-9f15b514336e could not be found. Aug 09 11:25:27.872997 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:25:27.874083 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-61e2fb05-e57b-45ed-b753-8b0535136e7f tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Returning 404 to user: Instance b683e1f9-1d37-46d4-a7a1-9f15b514336e could not be found. {{(pid=117685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:25:27.874083 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-61e2fb05-e57b-45ed-b753-8b0535136e7f tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e" status: 404 len: 111 microversion: 2.1 time: 0.060202 Aug 09 11:25:27.879640 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 523/1020] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:25:27 2022] GET /compute/v2.1/servers/b683e1f9-1d37-46d4-a7a1-9f15b514336e => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:25:28.148225 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-9c133820-c880-4ca6-9625-cb91c3e723dd tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] Calling method '.version_select at 0x7f2821f249d0>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:28.209542 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-9c133820-c880-4ca6-9625-cb91c3e723dd tempest-TestShelveInstance-1694314947 tempest-TestShelveInstance-1694314947-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1363296231" status: 202 len: 0 microversion: 2.1 time: 0.069218 Aug 09 11:25:28.210260 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 498/1021] 10.222.0.27 () {58 vars in 1254 bytes} [Tue Aug 9 11:25:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1363296231 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:25:54.801776 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-50c38267-09fd-4b43-85e1-8220e2ea482a tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:54.802635 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-50c38267-09fd-4b43-85e1-8220e2ea482a tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 935b9a57-1104-4ad6-a0ba-3301edf35661] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:25:54.805673 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:54.806740 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:54.815708 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-50c38267-09fd-4b43-85e1-8220e2ea482a tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:54.816294 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-50c38267-09fd-4b43-85e1-8220e2ea482a tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:54.816950 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-50c38267-09fd-4b43-85e1-8220e2ea482a tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:54.817666 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-50c38267-09fd-4b43-85e1-8220e2ea482a tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:54.818108 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-50c38267-09fd-4b43-85e1-8220e2ea482a tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:54.818532 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-50c38267-09fd-4b43-85e1-8220e2ea482a tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:54.846421 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-50c38267-09fd-4b43-85e1-8220e2ea482a tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 935b9a57-1104-4ad6-a0ba-3301edf35661] Going to try to terminate instance {{(pid=117685) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 11:25:54.934075 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-50c38267-09fd-4b43-85e1-8220e2ea482a tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "DELETE /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661" status: 204 len: 0 microversion: 2.1 time: 0.138533 Aug 09 11:25:54.938190 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 524/1022] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 9 11:25:54 2022] DELETE /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 11:25:54.943653 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-0907cf26-39b3-47af-ae26-4c27b7a391c7 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:54.944281 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-0907cf26-39b3-47af-ae26-4c27b7a391c7 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 935b9a57-1104-4ad6-a0ba-3301edf35661] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:25:54.946490 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:54.947227 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:54.953917 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0907cf26-39b3-47af-ae26-4c27b7a391c7 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:54.954396 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0907cf26-39b3-47af-ae26-4c27b7a391c7 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:54.954831 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0907cf26-39b3-47af-ae26-4c27b7a391c7 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:54.955525 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0907cf26-39b3-47af-ae26-4c27b7a391c7 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:54.955971 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0907cf26-39b3-47af-ae26-4c27b7a391c7 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:54.956424 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0907cf26-39b3-47af-ae26-4c27b7a391c7 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:55.404764 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-0907cf26-39b3-47af-ae26-4c27b7a391c7 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:25:55.416567 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-0907cf26-39b3-47af-ae26-4c27b7a391c7 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661" status: 200 len: 1578 microversion: 2.1 time: 0.476844 Aug 09 11:25:55.417153 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 499/1023] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:25:54 2022] GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661 => generated 1578 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:25:56.448469 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-359391d7-a2e4-4d8c-840c-ff41315edcc5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:56.449171 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-359391d7-a2e4-4d8c-840c-ff41315edcc5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 935b9a57-1104-4ad6-a0ba-3301edf35661] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:25:56.457023 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-359391d7-a2e4-4d8c-840c-ff41315edcc5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:56.457507 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-359391d7-a2e4-4d8c-840c-ff41315edcc5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:56.457934 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-359391d7-a2e4-4d8c-840c-ff41315edcc5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:56.458599 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-359391d7-a2e4-4d8c-840c-ff41315edcc5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:56.459069 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-359391d7-a2e4-4d8c-840c-ff41315edcc5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:56.459467 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-359391d7-a2e4-4d8c-840c-ff41315edcc5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:56.601863 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-359391d7-a2e4-4d8c-840c-ff41315edcc5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:25:56.610419 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-359391d7-a2e4-4d8c-840c-ff41315edcc5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661" status: 200 len: 1578 microversion: 2.1 time: 0.168767 Aug 09 11:25:56.611000 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 525/1024] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:25:56 2022] GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661 => generated 1578 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:25:57.633263 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-0a9e1500-65e6-4a2e-bc30-a237929104ba tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:57.633877 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-0a9e1500-65e6-4a2e-bc30-a237929104ba tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 935b9a57-1104-4ad6-a0ba-3301edf35661] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:25:57.643685 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0a9e1500-65e6-4a2e-bc30-a237929104ba tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:57.644345 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0a9e1500-65e6-4a2e-bc30-a237929104ba tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:57.644934 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0a9e1500-65e6-4a2e-bc30-a237929104ba tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:57.645878 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0a9e1500-65e6-4a2e-bc30-a237929104ba tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:57.646409 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0a9e1500-65e6-4a2e-bc30-a237929104ba tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:57.647073 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0a9e1500-65e6-4a2e-bc30-a237929104ba tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:57.792157 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-0a9e1500-65e6-4a2e-bc30-a237929104ba tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:25:57.800095 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-0a9e1500-65e6-4a2e-bc30-a237929104ba tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661" status: 200 len: 1578 microversion: 2.1 time: 0.172475 Aug 09 11:25:57.800705 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 500/1025] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:25:57 2022] GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661 => generated 1578 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:25:58.821878 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-eb16e25a-238a-42b5-9fba-0d5c0999058d tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:58.822506 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-eb16e25a-238a-42b5-9fba-0d5c0999058d tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 935b9a57-1104-4ad6-a0ba-3301edf35661] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:25:58.829796 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-eb16e25a-238a-42b5-9fba-0d5c0999058d tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:58.830272 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-eb16e25a-238a-42b5-9fba-0d5c0999058d tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:58.830703 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-eb16e25a-238a-42b5-9fba-0d5c0999058d tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:58.831390 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-eb16e25a-238a-42b5-9fba-0d5c0999058d tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:58.831836 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-eb16e25a-238a-42b5-9fba-0d5c0999058d tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:58.832252 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-eb16e25a-238a-42b5-9fba-0d5c0999058d tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:58.974577 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-eb16e25a-238a-42b5-9fba-0d5c0999058d tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:25:58.982469 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-eb16e25a-238a-42b5-9fba-0d5c0999058d tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661" status: 200 len: 1578 microversion: 2.1 time: 0.164586 Aug 09 11:25:58.983065 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 526/1026] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:25:58 2022] GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661 => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:00.006348 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-7b8103aa-051d-4451-9022-3193091871ca tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:00.007320 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-7b8103aa-051d-4451-9022-3193091871ca tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 935b9a57-1104-4ad6-a0ba-3301edf35661] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:00.017016 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7b8103aa-051d-4451-9022-3193091871ca tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:00.018209 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7b8103aa-051d-4451-9022-3193091871ca tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:00.018649 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7b8103aa-051d-4451-9022-3193091871ca tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:00.019353 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7b8103aa-051d-4451-9022-3193091871ca tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:00.019808 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7b8103aa-051d-4451-9022-3193091871ca tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:00.020229 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7b8103aa-051d-4451-9022-3193091871ca tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:00.163993 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-7b8103aa-051d-4451-9022-3193091871ca tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:00.173249 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-7b8103aa-051d-4451-9022-3193091871ca tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661" status: 200 len: 1578 microversion: 2.1 time: 0.173544 Aug 09 11:26:00.173752 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 501/1027] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:25:59 2022] GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661 => generated 1578 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:01.197679 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-3b3813e6-ff20-4ec8-a18f-97a1e1039a5a tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:01.199123 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-3b3813e6-ff20-4ec8-a18f-97a1e1039a5a tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 935b9a57-1104-4ad6-a0ba-3301edf35661] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:01.210163 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3b3813e6-ff20-4ec8-a18f-97a1e1039a5a tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:01.210937 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3b3813e6-ff20-4ec8-a18f-97a1e1039a5a tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:01.211679 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3b3813e6-ff20-4ec8-a18f-97a1e1039a5a tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:01.212899 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3b3813e6-ff20-4ec8-a18f-97a1e1039a5a tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:01.213674 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3b3813e6-ff20-4ec8-a18f-97a1e1039a5a tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:01.214367 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3b3813e6-ff20-4ec8-a18f-97a1e1039a5a tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:01.364972 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-3b3813e6-ff20-4ec8-a18f-97a1e1039a5a tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:01.376502 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-3b3813e6-ff20-4ec8-a18f-97a1e1039a5a tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661" status: 200 len: 1578 microversion: 2.1 time: 0.185345 Aug 09 11:26:01.377084 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 527/1028] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:01 2022] GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661 => generated 1578 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:02.398069 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-5a6e1bb4-c415-469b-8b19-85cee18a5a15 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:02.399022 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-5a6e1bb4-c415-469b-8b19-85cee18a5a15 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 935b9a57-1104-4ad6-a0ba-3301edf35661] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:02.405672 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5a6e1bb4-c415-469b-8b19-85cee18a5a15 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:02.406151 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5a6e1bb4-c415-469b-8b19-85cee18a5a15 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:02.406579 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5a6e1bb4-c415-469b-8b19-85cee18a5a15 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:02.407274 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5a6e1bb4-c415-469b-8b19-85cee18a5a15 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:02.407720 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5a6e1bb4-c415-469b-8b19-85cee18a5a15 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:02.408138 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5a6e1bb4-c415-469b-8b19-85cee18a5a15 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:02.544152 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-5a6e1bb4-c415-469b-8b19-85cee18a5a15 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:02.552869 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-5a6e1bb4-c415-469b-8b19-85cee18a5a15 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661" status: 200 len: 1578 microversion: 2.1 time: 0.158758 Aug 09 11:26:02.553438 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 502/1029] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:02 2022] GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661 => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:03.449986 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-87fead1e-888c-4f5e-82b2-ae919bfa174e req-58c0230d-4e18-4d58-8d3d-ea4b611415d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "935b9a57-1104-4ad6-a0ba-3301edf35661", "name": "network-vif-deleted", "tag": "d9a273cd-bfdb-4a55-a1e8-c1fbe783a476"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:26:03.459991 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-87fead1e-888c-4f5e-82b2-ae919bfa174e req-58c0230d-4e18-4d58-8d3d-ea4b611415d5 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:03.460503 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-87fead1e-888c-4f5e-82b2-ae919bfa174e req-58c0230d-4e18-4d58-8d3d-ea4b611415d5 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:03.460928 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-87fead1e-888c-4f5e-82b2-ae919bfa174e req-58c0230d-4e18-4d58-8d3d-ea4b611415d5 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:03.472081 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-87fead1e-888c-4f5e-82b2-ae919bfa174e req-58c0230d-4e18-4d58-8d3d-ea4b611415d5 service nova] Creating event network-vif-deleted:d9a273cd-bfdb-4a55-a1e8-c1fbe783a476 for instance 935b9a57-1104-4ad6-a0ba-3301edf35661 on hv-cinder-85251 Aug 09 11:26:03.476992 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-87fead1e-888c-4f5e-82b2-ae919bfa174e req-58c0230d-4e18-4d58-8d3d-ea4b611415d5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030780 Aug 09 11:26:03.477575 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 528/1030] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:26:03.574462 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-263a2474-1544-40bd-a62f-b4ca6eb683ac tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:03.575360 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-263a2474-1544-40bd-a62f-b4ca6eb683ac tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 935b9a57-1104-4ad6-a0ba-3301edf35661] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:03.582726 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-263a2474-1544-40bd-a62f-b4ca6eb683ac tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:03.583336 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-263a2474-1544-40bd-a62f-b4ca6eb683ac tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:03.583842 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-263a2474-1544-40bd-a62f-b4ca6eb683ac tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:03.584656 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-263a2474-1544-40bd-a62f-b4ca6eb683ac tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:03.585182 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-263a2474-1544-40bd-a62f-b4ca6eb683ac tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:03.585817 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-263a2474-1544-40bd-a62f-b4ca6eb683ac tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:03.656109 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-263a2474-1544-40bd-a62f-b4ca6eb683ac tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:03.663916 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-263a2474-1544-40bd-a62f-b4ca6eb683ac tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661" status: 200 len: 1510 microversion: 2.1 time: 0.093372 Aug 09 11:26:03.664528 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 503/1031] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:03 2022] GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661 => generated 1510 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:04.691425 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-2e470643-97cc-426c-a4db-ccce72c751ad tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:04.692405 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-2e470643-97cc-426c-a4db-ccce72c751ad tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 935b9a57-1104-4ad6-a0ba-3301edf35661] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:04.703225 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2e470643-97cc-426c-a4db-ccce72c751ad tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:04.703708 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2e470643-97cc-426c-a4db-ccce72c751ad tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:04.704143 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2e470643-97cc-426c-a4db-ccce72c751ad tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:04.704882 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2e470643-97cc-426c-a4db-ccce72c751ad tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:04.705302 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2e470643-97cc-426c-a4db-ccce72c751ad tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:04.705715 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2e470643-97cc-426c-a4db-ccce72c751ad tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:04.770901 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-2e470643-97cc-426c-a4db-ccce72c751ad tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:04.780613 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-2e470643-97cc-426c-a4db-ccce72c751ad tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661" status: 200 len: 1510 microversion: 2.1 time: 0.096957 Aug 09 11:26:04.781353 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 529/1032] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:04 2022] GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661 => generated 1510 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:05.803569 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-6fdf47f4-532d-4320-bdc1-925d2748e731 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:05.804306 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-6fdf47f4-532d-4320-bdc1-925d2748e731 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 935b9a57-1104-4ad6-a0ba-3301edf35661] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:05.811091 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6fdf47f4-532d-4320-bdc1-925d2748e731 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:05.811655 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6fdf47f4-532d-4320-bdc1-925d2748e731 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:05.812096 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6fdf47f4-532d-4320-bdc1-925d2748e731 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:05.812817 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6fdf47f4-532d-4320-bdc1-925d2748e731 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:05.813271 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6fdf47f4-532d-4320-bdc1-925d2748e731 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:05.813692 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6fdf47f4-532d-4320-bdc1-925d2748e731 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:05.882995 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-6fdf47f4-532d-4320-bdc1-925d2748e731 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:05.893313 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-6fdf47f4-532d-4320-bdc1-925d2748e731 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661" status: 200 len: 1226 microversion: 2.1 time: 0.094328 Aug 09 11:26:05.894116 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 504/1033] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:05 2022] GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:06.916161 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-771270f4-efb4-48ec-a50f-bb8b8d59dc6e tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:06.916766 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-771270f4-efb4-48ec-a50f-bb8b8d59dc6e tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 935b9a57-1104-4ad6-a0ba-3301edf35661] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:06.924655 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-771270f4-efb4-48ec-a50f-bb8b8d59dc6e tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:06.925142 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-771270f4-efb4-48ec-a50f-bb8b8d59dc6e tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:06.925580 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-771270f4-efb4-48ec-a50f-bb8b8d59dc6e tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:06.926280 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-771270f4-efb4-48ec-a50f-bb8b8d59dc6e tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:06.926726 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-771270f4-efb4-48ec-a50f-bb8b8d59dc6e tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:06.927145 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-771270f4-efb4-48ec-a50f-bb8b8d59dc6e tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:06.994057 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-771270f4-efb4-48ec-a50f-bb8b8d59dc6e tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:07.006379 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-771270f4-efb4-48ec-a50f-bb8b8d59dc6e tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661" status: 200 len: 1226 microversion: 2.1 time: 0.090523 Aug 09 11:26:07.006379 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 530/1034] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:06 2022] GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:08.024840 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-2650c729-9cd6-42e8-92c9-6eb008b59fdd tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:08.025598 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-2650c729-9cd6-42e8-92c9-6eb008b59fdd tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 935b9a57-1104-4ad6-a0ba-3301edf35661] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:08.033724 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2650c729-9cd6-42e8-92c9-6eb008b59fdd tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:08.034203 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2650c729-9cd6-42e8-92c9-6eb008b59fdd tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:08.034636 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2650c729-9cd6-42e8-92c9-6eb008b59fdd tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:08.035516 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2650c729-9cd6-42e8-92c9-6eb008b59fdd tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:08.035738 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2650c729-9cd6-42e8-92c9-6eb008b59fdd tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:08.036153 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2650c729-9cd6-42e8-92c9-6eb008b59fdd tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:08.103138 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-2650c729-9cd6-42e8-92c9-6eb008b59fdd tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:08.110988 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-2650c729-9cd6-42e8-92c9-6eb008b59fdd tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661" status: 200 len: 1226 microversion: 2.1 time: 0.091250 Aug 09 11:26:08.111565 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 505/1035] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:08 2022] GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:09.138243 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-6e670941-9b1e-42b9-b9ae-efd578a324fc tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:09.138822 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-6e670941-9b1e-42b9-b9ae-efd578a324fc tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 935b9a57-1104-4ad6-a0ba-3301edf35661] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:09.145619 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6e670941-9b1e-42b9-b9ae-efd578a324fc tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:09.146085 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6e670941-9b1e-42b9-b9ae-efd578a324fc tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:09.146508 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6e670941-9b1e-42b9-b9ae-efd578a324fc tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:09.147180 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6e670941-9b1e-42b9-b9ae-efd578a324fc tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:09.147727 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6e670941-9b1e-42b9-b9ae-efd578a324fc tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:09.148142 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6e670941-9b1e-42b9-b9ae-efd578a324fc tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:09.210867 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-6e670941-9b1e-42b9-b9ae-efd578a324fc tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:09.218844 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-6e670941-9b1e-42b9-b9ae-efd578a324fc tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661" status: 200 len: 1226 microversion: 2.1 time: 0.084585 Aug 09 11:26:09.219419 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 531/1036] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:09 2022] GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:10.241215 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-4864c26e-42f2-4d4c-87c9-8c9b0fb8d30f tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:10.241856 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-4864c26e-42f2-4d4c-87c9-8c9b0fb8d30f tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 935b9a57-1104-4ad6-a0ba-3301edf35661] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:10.249464 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4864c26e-42f2-4d4c-87c9-8c9b0fb8d30f tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:10.249972 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4864c26e-42f2-4d4c-87c9-8c9b0fb8d30f tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:10.250408 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4864c26e-42f2-4d4c-87c9-8c9b0fb8d30f tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:10.251165 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4864c26e-42f2-4d4c-87c9-8c9b0fb8d30f tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:10.252529 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4864c26e-42f2-4d4c-87c9-8c9b0fb8d30f tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:10.252529 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4864c26e-42f2-4d4c-87c9-8c9b0fb8d30f tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:10.268622 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.wsgi [None req-4864c26e-42f2-4d4c-87c9-8c9b0fb8d30f tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] HTTP exception thrown: Instance 935b9a57-1104-4ad6-a0ba-3301edf35661 could not be found. Aug 09 11:26:10.270279 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-4864c26e-42f2-4d4c-87c9-8c9b0fb8d30f tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Request method failure captured: Aug 09 11:26:10.270279 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: request: GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661 HTTP/1.1 Aug 09 11:26:10.270279 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept: application/json Aug 09 11:26:10.270279 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept-Encoding: identity Aug 09 11:26:10.270279 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Connection: close Aug 09 11:26:10.270279 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Length: 0 Aug 09 11:26:10.270279 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Type: application/json Aug 09 11:26:10.270279 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Host: 10.222.0.27 Aug 09 11:26:10.270279 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Openstack-System-Scope: None Aug 09 11:26:10.270279 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: User-Agent: python-urllib3/1.26.11 Aug 09 11:26:10.270279 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Auth-Token: gAAAAABi8kOSqBDhhheNHFXQC96sdrHL714LO7y9IM1Cd2MzmODs85Pa0AMSSTdl7t1_D4T9ywKgKiyJRwch62n-k-E0Cc5pubZWfo5TMk-U3KI3XaWUhA4CgUdKGTMgQkLSjcw22aBZmAyFdNDBnv73AYrYgmma8uR2-CCpbr5WgbSXeHOiK9A Aug 09 11:26:10.270279 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Id: None Aug 09 11:26:10.270279 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Name: None Aug 09 11:26:10.270279 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Identity-Status: Confirmed Aug 09 11:26:10.270279 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Is-Admin-Project: True Aug 09 11:26:10.270279 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Id: default Aug 09 11:26:10.270279 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Name: Default Aug 09 11:26:10.270279 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Id: bfd671fcff7e4b24b5415a3a1b70ad0f Aug 09 11:26:10.270279 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Name: tempest-TestVolumeBootPattern-2035807174 Aug 09 11:26:10.270279 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Role: member,reader Aug 09 11:26:10.270279 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Roles: member,reader Aug 09 11:26:10.272197 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bfd671fcff7e4b24b5415a3a1b70ad0f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bfd671fcff7e4b24b5415a3a1b70ad0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bfd671fcff7e4b24b5415a3a1b70ad0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bfd671fcff7e4b24b5415a3a1b70ad0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:26:10.272197 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant: tempest-TestVolumeBootPattern-2035807174 Aug 09 11:26:10.272197 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Id: bfd671fcff7e4b24b5415a3a1b70ad0f Aug 09 11:26:10.272197 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Name: tempest-TestVolumeBootPattern-2035807174 Aug 09 11:26:10.272197 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User: tempest-TestVolumeBootPattern-2035807174-project Aug 09 11:26:10.272197 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Id: default Aug 09 11:26:10.272197 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Name: Default Aug 09 11:26:10.272197 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Id: 5b4c4030b5fb4381a598a54588880b75 Aug 09 11:26:10.272197 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Name: tempest-TestVolumeBootPattern-2035807174-project Aug 09 11:26:10.272197 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: method: > Aug 09 11:26:10.272197 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: exception: Instance 935b9a57-1104-4ad6-a0ba-3301edf35661 could not be found. Aug 09 11:26:10.272197 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: action_args: {'id': '935b9a57-1104-4ad6-a0ba-3301edf35661'} Aug 09 11:26:10.273755 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:26:10.273755 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:26:10.273755 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:26:10.273755 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:26:10.273755 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:26:10.273755 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:26:10.273755 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:26:10.273755 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:26:10.273755 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:26:10.273755 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:26:10.273755 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 935b9a57-1104-4ad6-a0ba-3301edf35661 could not be found. Aug 09 11:26:10.273755 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:26:10.273755 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:26:10.273755 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:26:10.273755 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:26:10.273755 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:26:10.273755 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:26:10.273755 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:26:10.273755 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:26:10.273755 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:26:10.275311 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:26:10.275311 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:26:10.275311 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:26:10.275311 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:26:10.275311 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:26:10.275311 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:26:10.275311 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:26:10.275311 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 935b9a57-1104-4ad6-a0ba-3301edf35661 could not be found. Aug 09 11:26:10.275311 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:26:10.275311 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:26:10.275311 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:26:10.275311 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:26:10.275311 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:26:10.275311 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:26:10.275311 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:26:10.275311 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:26:10.275311 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 935b9a57-1104-4ad6-a0ba-3301edf35661 could not be found. Aug 09 11:26:10.275311 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:26:10.276702 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-4864c26e-42f2-4d4c-87c9-8c9b0fb8d30f tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Returning 404 to user: Instance 935b9a57-1104-4ad6-a0ba-3301edf35661 could not be found. {{(pid=117684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:26:10.276702 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-4864c26e-42f2-4d4c-87c9-8c9b0fb8d30f tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661" status: 404 len: 111 microversion: 2.1 time: 0.035858 Aug 09 11:26:10.276702 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 506/1037] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:10 2022] GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:26:10.380231 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-14fbe65a-e837-4a98-980d-51a1f277aab7 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2134468224", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1024053701", "security_groups": [{"name": "tempest-secgroup-smoke-1801499321"}], "block_device_mapping_v2": [{"uuid": "a253af8c-01cb-4bad-8319-721eab47729f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "940543e4-99c0-4b6e-ad06-93fe4eaedd74"}]}} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:26:10.504349 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.network.neutron [None req-14fbe65a-e837-4a98-980d-51a1f277aab7 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] validate_networks() for [('940543e4-99c0-4b6e-ad06-93fe4eaedd74', None, None, None, None, None)] {{(pid=117685) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 11:26:10.905717 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-14fbe65a-e837-4a98-980d-51a1f277aab7 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Flavor limits 0:0:0 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 11:26:10.906205 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-14fbe65a-e837-4a98-980d-51a1f277aab7 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Image limits 0:0:0 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 11:26:10.906891 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-14fbe65a-e837-4a98-980d-51a1f277aab7 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Flavor pref 0:0:0 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 11:26:10.907535 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-14fbe65a-e837-4a98-980d-51a1f277aab7 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Image pref 0:0:0 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 11:26:10.908470 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-14fbe65a-e837-4a98-980d-51a1f277aab7 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 11:26:10.920977 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-14fbe65a-e837-4a98-980d-51a1f277aab7 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:10.921416 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-14fbe65a-e837-4a98-980d-51a1f277aab7 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:10.922192 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-14fbe65a-e837-4a98-980d-51a1f277aab7 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:10.923256 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-14fbe65a-e837-4a98-980d-51a1f277aab7 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:10.924297 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-14fbe65a-e837-4a98-980d-51a1f277aab7 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:10.925050 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-14fbe65a-e837-4a98-980d-51a1f277aab7 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:10.958747 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.quota [None req-14fbe65a-e837-4a98-980d-51a1f277aab7 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Getting quotas for project bfd671fcff7e4b24b5415a3a1b70ad0f. Resources: {'cores', 'instances', 'ram'} {{(pid=117685) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:26:10.963227 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.quota [None req-14fbe65a-e837-4a98-980d-51a1f277aab7 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Getting quotas for user 5b4c4030b5fb4381a598a54588880b75 and project bfd671fcff7e4b24b5415a3a1b70ad0f. Resources: {'cores', 'instances', 'ram'} {{(pid=117685) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:26:11.058711 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-14fbe65a-e837-4a98-980d-51a1f277aab7 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Going to run 1 instances... {{(pid=117685) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 11:26:11.061151 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-14fbe65a-e837-4a98-980d-51a1f277aab7 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 26cff99f-ec69-43f4-b0be-dda5ce2ccd51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a253af8c-01cb-4bad-8319-721eab47729f',volume_size=None,volume_type=None)] {{(pid=117685) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 11:26:11.262374 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-14fbe65a-e837-4a98-980d-51a1f277aab7 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.886611 Aug 09 11:26:11.263682 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 532/1038] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 9 11:26:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 889 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 11:26:11.275017 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-be550559-4a58-4c34-aed4-863361fe50ad tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:11.275630 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-be550559-4a58-4c34-aed4-863361fe50ad tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 26cff99f-ec69-43f4-b0be-dda5ce2ccd51] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:11.344182 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-be550559-4a58-4c34-aed4-863361fe50ad tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:11.351160 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-be550559-4a58-4c34-aed4-863361fe50ad tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51" status: 200 len: 1095 microversion: 2.1 time: 0.080370 Aug 09 11:26:11.351718 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 507/1039] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:11 2022] GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51 => generated 1095 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:12.371395 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-97a624a1-ee94-4c14-9d6a-a899df39fd33 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:12.372720 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-97a624a1-ee94-4c14-9d6a-a899df39fd33 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 26cff99f-ec69-43f4-b0be-dda5ce2ccd51] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:12.442019 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-97a624a1-ee94-4c14-9d6a-a899df39fd33 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:12.448312 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-97a624a1-ee94-4c14-9d6a-a899df39fd33 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51" status: 200 len: 1095 microversion: 2.1 time: 0.080922 Aug 09 11:26:12.448875 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 533/1040] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:12 2022] GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51 => generated 1095 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:26:13.469014 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-47712ad9-126d-4e25-a8e8-d7ba0014f9cc tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:13.469745 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-47712ad9-126d-4e25-a8e8-d7ba0014f9cc tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 26cff99f-ec69-43f4-b0be-dda5ce2ccd51] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:13.530096 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-47712ad9-126d-4e25-a8e8-d7ba0014f9cc tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:13.537024 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-47712ad9-126d-4e25-a8e8-d7ba0014f9cc tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51" status: 200 len: 1095 microversion: 2.1 time: 0.072459 Aug 09 11:26:13.537620 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 508/1041] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:13 2022] GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51 => generated 1095 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:14.557147 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-77c9cc29-13c1-4a92-81f8-bf4d247ee421 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:14.557761 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-77c9cc29-13c1-4a92-81f8-bf4d247ee421 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 26cff99f-ec69-43f4-b0be-dda5ce2ccd51] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:14.615418 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-77c9cc29-13c1-4a92-81f8-bf4d247ee421 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:14.622936 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-77c9cc29-13c1-4a92-81f8-bf4d247ee421 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51" status: 200 len: 1095 microversion: 2.1 time: 0.069567 Aug 09 11:26:14.623763 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 534/1042] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:14 2022] GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51 => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:15.649337 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-73fe48db-b537-46e6-9c12-ce80aca266da tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:15.650173 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-73fe48db-b537-46e6-9c12-ce80aca266da tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 26cff99f-ec69-43f4-b0be-dda5ce2ccd51] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:15.658558 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-73fe48db-b537-46e6-9c12-ce80aca266da tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:15.659180 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-73fe48db-b537-46e6-9c12-ce80aca266da tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:15.659687 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-73fe48db-b537-46e6-9c12-ce80aca266da tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:15.660590 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-73fe48db-b537-46e6-9c12-ce80aca266da tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:15.661200 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-73fe48db-b537-46e6-9c12-ce80aca266da tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:15.661748 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-73fe48db-b537-46e6-9c12-ce80aca266da tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:15.742649 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-73fe48db-b537-46e6-9c12-ce80aca266da tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:15.754228 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-73fe48db-b537-46e6-9c12-ce80aca266da tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51" status: 200 len: 1145 microversion: 2.1 time: 0.111625 Aug 09 11:26:15.755859 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 509/1043] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:15 2022] GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51 => generated 1145 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:16.780750 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-708b61eb-c518-48dd-b57d-641271d94f9e tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:16.781804 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-708b61eb-c518-48dd-b57d-641271d94f9e tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 26cff99f-ec69-43f4-b0be-dda5ce2ccd51] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:16.790626 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-708b61eb-c518-48dd-b57d-641271d94f9e tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:16.791112 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-708b61eb-c518-48dd-b57d-641271d94f9e tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:16.791544 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-708b61eb-c518-48dd-b57d-641271d94f9e tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:16.792285 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-708b61eb-c518-48dd-b57d-641271d94f9e tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:16.792725 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-708b61eb-c518-48dd-b57d-641271d94f9e tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:16.793238 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-708b61eb-c518-48dd-b57d-641271d94f9e tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:16.868435 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-708b61eb-c518-48dd-b57d-641271d94f9e tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:16.876549 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-708b61eb-c518-48dd-b57d-641271d94f9e tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51" status: 200 len: 1137 microversion: 2.1 time: 0.102845 Aug 09 11:26:16.877124 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 535/1044] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:16 2022] GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51 => generated 1137 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:17.901068 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-0c05e762-c45c-417a-a6f2-592a4c01c393 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:17.902368 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-0c05e762-c45c-417a-a6f2-592a4c01c393 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 26cff99f-ec69-43f4-b0be-dda5ce2ccd51] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:17.910401 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0c05e762-c45c-417a-a6f2-592a4c01c393 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:17.911111 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0c05e762-c45c-417a-a6f2-592a4c01c393 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:17.911718 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0c05e762-c45c-417a-a6f2-592a4c01c393 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:17.914123 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0c05e762-c45c-417a-a6f2-592a4c01c393 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:17.914763 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0c05e762-c45c-417a-a6f2-592a4c01c393 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:17.915408 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-0c05e762-c45c-417a-a6f2-592a4c01c393 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:17.985293 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-0c05e762-c45c-417a-a6f2-592a4c01c393 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:17.994752 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-0c05e762-c45c-417a-a6f2-592a4c01c393 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51" status: 200 len: 1193 microversion: 2.1 time: 0.099729 Aug 09 11:26:17.996352 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 510/1045] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:17 2022] GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51 => generated 1193 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:19.016477 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-41d955f8-a513-4922-a8ad-2c95e540c114 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:19.017867 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-41d955f8-a513-4922-a8ad-2c95e540c114 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 26cff99f-ec69-43f4-b0be-dda5ce2ccd51] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:19.027012 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-41d955f8-a513-4922-a8ad-2c95e540c114 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:19.027929 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-41d955f8-a513-4922-a8ad-2c95e540c114 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:19.028680 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-41d955f8-a513-4922-a8ad-2c95e540c114 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:19.029688 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-41d955f8-a513-4922-a8ad-2c95e540c114 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:19.030477 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-41d955f8-a513-4922-a8ad-2c95e540c114 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:19.031268 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-41d955f8-a513-4922-a8ad-2c95e540c114 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:19.249250 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-41d955f8-a513-4922-a8ad-2c95e540c114 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:19.257443 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-41d955f8-a513-4922-a8ad-2c95e540c114 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51" status: 200 len: 1279 microversion: 2.1 time: 0.245941 Aug 09 11:26:19.258028 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 536/1046] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:19 2022] GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51 => generated 1279 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:19.482993 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [req-241e9d05-a66f-4cbc-b774-e9b76b61ed80 req-98e5912d-3f2a-4b71-800f-e2537fb66fe5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26cff99f-ec69-43f4-b0be-dda5ce2ccd51", "tag": "78730e1b-ce01-4a35-9f7e-01c214a347ad"}]} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:26:19.495783 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-241e9d05-a66f-4cbc-b774-e9b76b61ed80 req-98e5912d-3f2a-4b71-800f-e2537fb66fe5 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:19.496558 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-241e9d05-a66f-4cbc-b774-e9b76b61ed80 req-98e5912d-3f2a-4b71-800f-e2537fb66fe5 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:19.497056 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-241e9d05-a66f-4cbc-b774-e9b76b61ed80 req-98e5912d-3f2a-4b71-800f-e2537fb66fe5 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:19.509990 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.compute.server_external_events [req-241e9d05-a66f-4cbc-b774-e9b76b61ed80 req-98e5912d-3f2a-4b71-800f-e2537fb66fe5 service nova] Creating event network-changed:78730e1b-ce01-4a35-9f7e-01c214a347ad for instance 26cff99f-ec69-43f4-b0be-dda5ce2ccd51 on hv-cinder-85251 Aug 09 11:26:19.515621 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [req-241e9d05-a66f-4cbc-b774-e9b76b61ed80 req-98e5912d-3f2a-4b71-800f-e2537fb66fe5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036362 Aug 09 11:26:19.516203 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 511/1047] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:26:20.278681 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-8752288d-194d-4884-84fd-4c8b536bce99 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:20.279303 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-8752288d-194d-4884-84fd-4c8b536bce99 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 26cff99f-ec69-43f4-b0be-dda5ce2ccd51] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:20.286062 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8752288d-194d-4884-84fd-4c8b536bce99 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:20.286547 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8752288d-194d-4884-84fd-4c8b536bce99 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:20.286981 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8752288d-194d-4884-84fd-4c8b536bce99 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:20.287672 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8752288d-194d-4884-84fd-4c8b536bce99 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:20.288139 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8752288d-194d-4884-84fd-4c8b536bce99 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:20.288582 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-8752288d-194d-4884-84fd-4c8b536bce99 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:20.502484 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-8752288d-194d-4884-84fd-4c8b536bce99 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:20.510301 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-8752288d-194d-4884-84fd-4c8b536bce99 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51" status: 200 len: 1279 microversion: 2.1 time: 0.235672 Aug 09 11:26:20.511019 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 537/1048] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:20 2022] GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51 => generated 1279 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:21.536399 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-a861ef08-f798-4ed8-ba7d-cc6d5ba636ce tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:21.537281 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-a861ef08-f798-4ed8-ba7d-cc6d5ba636ce tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 26cff99f-ec69-43f4-b0be-dda5ce2ccd51] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:21.545624 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a861ef08-f798-4ed8-ba7d-cc6d5ba636ce tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:21.546147 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a861ef08-f798-4ed8-ba7d-cc6d5ba636ce tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:21.546822 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a861ef08-f798-4ed8-ba7d-cc6d5ba636ce tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:21.547864 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a861ef08-f798-4ed8-ba7d-cc6d5ba636ce tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:21.548854 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a861ef08-f798-4ed8-ba7d-cc6d5ba636ce tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:21.549579 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-a861ef08-f798-4ed8-ba7d-cc6d5ba636ce tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:21.729045 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-a861ef08-f798-4ed8-ba7d-cc6d5ba636ce tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:21.737299 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-a861ef08-f798-4ed8-ba7d-cc6d5ba636ce tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51" status: 200 len: 1279 microversion: 2.1 time: 0.207906 Aug 09 11:26:21.737833 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 512/1049] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:21 2022] GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51 => generated 1279 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:22.760917 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-1fc6e650-f098-4a89-96bf-41c373b03254 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:22.761653 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-1fc6e650-f098-4a89-96bf-41c373b03254 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 26cff99f-ec69-43f4-b0be-dda5ce2ccd51] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:22.764217 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell0:SELECT=2 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:22.772116 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1fc6e650-f098-4a89-96bf-41c373b03254 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:22.772765 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1fc6e650-f098-4a89-96bf-41c373b03254 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:22.773357 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1fc6e650-f098-4a89-96bf-41c373b03254 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:22.774656 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1fc6e650-f098-4a89-96bf-41c373b03254 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:22.775363 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1fc6e650-f098-4a89-96bf-41c373b03254 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:22.775931 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1fc6e650-f098-4a89-96bf-41c373b03254 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:22.918496 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-1fc6e650-f098-4a89-96bf-41c373b03254 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:22.926228 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-1fc6e650-f098-4a89-96bf-41c373b03254 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51" status: 200 len: 1267 microversion: 2.1 time: 0.171163 Aug 09 11:26:22.926813 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 538/1050] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:22 2022] GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:23.228061 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 11:26:23.228604 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Tue Aug 9 11:26:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 11:26:23.944645 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell0:SELECT=4 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:23.948625 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-e3e61ba4-f167-469b-9892-a46f55ab1d30 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:23.949236 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-e3e61ba4-f167-469b-9892-a46f55ab1d30 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 26cff99f-ec69-43f4-b0be-dda5ce2ccd51] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:23.956254 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e3e61ba4-f167-469b-9892-a46f55ab1d30 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:23.956785 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e3e61ba4-f167-469b-9892-a46f55ab1d30 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:23.957229 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e3e61ba4-f167-469b-9892-a46f55ab1d30 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:23.957930 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e3e61ba4-f167-469b-9892-a46f55ab1d30 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:23.958384 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e3e61ba4-f167-469b-9892-a46f55ab1d30 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:23.958809 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e3e61ba4-f167-469b-9892-a46f55ab1d30 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:24.092948 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-e3e61ba4-f167-469b-9892-a46f55ab1d30 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:24.100933 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-e3e61ba4-f167-469b-9892-a46f55ab1d30 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51" status: 200 len: 1267 microversion: 2.1 time: 0.157547 Aug 09 11:26:24.101465 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 513/1051] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:23 2022] GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:25.121872 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-efaddffb-3237-4fb8-8788-cfe47b9a6f66 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:25.122481 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-efaddffb-3237-4fb8-8788-cfe47b9a6f66 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 26cff99f-ec69-43f4-b0be-dda5ce2ccd51] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:25.124830 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell0:SELECT=10 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:25.125487 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:25.131007 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-efaddffb-3237-4fb8-8788-cfe47b9a6f66 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:25.131525 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-efaddffb-3237-4fb8-8788-cfe47b9a6f66 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:25.131959 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-efaddffb-3237-4fb8-8788-cfe47b9a6f66 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:25.132678 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-efaddffb-3237-4fb8-8788-cfe47b9a6f66 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:25.133123 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-efaddffb-3237-4fb8-8788-cfe47b9a6f66 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:25.133539 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-efaddffb-3237-4fb8-8788-cfe47b9a6f66 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:25.137439 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:25.282555 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-efaddffb-3237-4fb8-8788-cfe47b9a6f66 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:25.290709 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-efaddffb-3237-4fb8-8788-cfe47b9a6f66 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51" status: 200 len: 1267 microversion: 2.1 time: 0.172933 Aug 09 11:26:25.291271 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 539/1052] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:25 2022] GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:26.312023 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-4054f218-ac13-4ba5-a959-d279f59e426c tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:26.312926 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-4054f218-ac13-4ba5-a959-d279f59e426c tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 26cff99f-ec69-43f4-b0be-dda5ce2ccd51] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:26.315379 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_api:SELECT=35 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:26.321484 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4054f218-ac13-4ba5-a959-d279f59e426c tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:26.322021 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4054f218-ac13-4ba5-a959-d279f59e426c tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:26.322782 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4054f218-ac13-4ba5-a959-d279f59e426c tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:26.323502 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4054f218-ac13-4ba5-a959-d279f59e426c tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:26.324246 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4054f218-ac13-4ba5-a959-d279f59e426c tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:26.324702 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4054f218-ac13-4ba5-a959-d279f59e426c tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:26.327521 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell1:SELECT=71 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:26.468233 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-4054f218-ac13-4ba5-a959-d279f59e426c tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:26.476141 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-4054f218-ac13-4ba5-a959-d279f59e426c tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51" status: 200 len: 1267 microversion: 2.1 time: 0.168101 Aug 09 11:26:26.476762 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 514/1053] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:26 2022] GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:27.504659 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-255261e5-00ee-4f83-b6d2-daff6bf9416a tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:27.505107 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-255261e5-00ee-4f83-b6d2-daff6bf9416a tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 26cff99f-ec69-43f4-b0be-dda5ce2ccd51] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:27.510835 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-255261e5-00ee-4f83-b6d2-daff6bf9416a tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:27.511349 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-255261e5-00ee-4f83-b6d2-daff6bf9416a tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:27.511783 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-255261e5-00ee-4f83-b6d2-daff6bf9416a tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:27.512542 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-255261e5-00ee-4f83-b6d2-daff6bf9416a tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:27.512989 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-255261e5-00ee-4f83-b6d2-daff6bf9416a tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:27.513410 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-255261e5-00ee-4f83-b6d2-daff6bf9416a tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:27.677569 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-255261e5-00ee-4f83-b6d2-daff6bf9416a tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:27.685754 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-255261e5-00ee-4f83-b6d2-daff6bf9416a tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51" status: 200 len: 1267 microversion: 2.1 time: 0.192642 Aug 09 11:26:27.686321 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 540/1054] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:27 2022] GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51 => generated 1267 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:28.707864 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-caa9668c-e03c-4b36-b8de-edcb72855fc3 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:28.708664 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-caa9668c-e03c-4b36-b8de-edcb72855fc3 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 26cff99f-ec69-43f4-b0be-dda5ce2ccd51] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:28.717260 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-caa9668c-e03c-4b36-b8de-edcb72855fc3 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:28.717862 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-caa9668c-e03c-4b36-b8de-edcb72855fc3 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:28.718409 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-caa9668c-e03c-4b36-b8de-edcb72855fc3 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:28.719266 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-caa9668c-e03c-4b36-b8de-edcb72855fc3 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:28.719830 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-caa9668c-e03c-4b36-b8de-edcb72855fc3 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:28.720373 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-caa9668c-e03c-4b36-b8de-edcb72855fc3 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:28.853879 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-caa9668c-e03c-4b36-b8de-edcb72855fc3 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:28.862100 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-caa9668c-e03c-4b36-b8de-edcb72855fc3 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51" status: 200 len: 1267 microversion: 2.1 time: 0.159243 Aug 09 11:26:28.862669 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 515/1055] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:28 2022] GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:29.883516 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-1d5facc7-cb1b-45f0-8718-6f51ede01fe5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:29.884116 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-1d5facc7-cb1b-45f0-8718-6f51ede01fe5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 26cff99f-ec69-43f4-b0be-dda5ce2ccd51] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:29.890591 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1d5facc7-cb1b-45f0-8718-6f51ede01fe5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:29.891077 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1d5facc7-cb1b-45f0-8718-6f51ede01fe5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:29.891503 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1d5facc7-cb1b-45f0-8718-6f51ede01fe5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:29.892198 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1d5facc7-cb1b-45f0-8718-6f51ede01fe5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:29.892670 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1d5facc7-cb1b-45f0-8718-6f51ede01fe5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:29.893108 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-1d5facc7-cb1b-45f0-8718-6f51ede01fe5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:30.044037 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-1d5facc7-cb1b-45f0-8718-6f51ede01fe5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:30.051691 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-1d5facc7-cb1b-45f0-8718-6f51ede01fe5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51" status: 200 len: 1267 microversion: 2.1 time: 0.172288 Aug 09 11:26:30.052287 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 541/1056] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:29 2022] GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:31.074658 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-3d3457db-a035-4123-9c51-04208a8f53f3 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:31.076040 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-3d3457db-a035-4123-9c51-04208a8f53f3 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 26cff99f-ec69-43f4-b0be-dda5ce2ccd51] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:31.084185 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3d3457db-a035-4123-9c51-04208a8f53f3 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:31.084707 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3d3457db-a035-4123-9c51-04208a8f53f3 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:31.085233 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3d3457db-a035-4123-9c51-04208a8f53f3 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:31.086004 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3d3457db-a035-4123-9c51-04208a8f53f3 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:31.086763 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3d3457db-a035-4123-9c51-04208a8f53f3 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:31.087348 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-3d3457db-a035-4123-9c51-04208a8f53f3 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:31.264321 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-3d3457db-a035-4123-9c51-04208a8f53f3 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:31.272063 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-3d3457db-a035-4123-9c51-04208a8f53f3 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51" status: 200 len: 1267 microversion: 2.1 time: 0.202428 Aug 09 11:26:31.272786 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 516/1057] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:31 2022] GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51 => generated 1267 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:32.295513 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-152d7f66-6710-430b-8890-d453ea95d517 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:32.296805 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-152d7f66-6710-430b-8890-d453ea95d517 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 26cff99f-ec69-43f4-b0be-dda5ce2ccd51] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:32.308225 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-152d7f66-6710-430b-8890-d453ea95d517 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:32.308751 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-152d7f66-6710-430b-8890-d453ea95d517 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:32.309190 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-152d7f66-6710-430b-8890-d453ea95d517 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:32.309912 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-152d7f66-6710-430b-8890-d453ea95d517 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:32.310358 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-152d7f66-6710-430b-8890-d453ea95d517 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:32.310785 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-152d7f66-6710-430b-8890-d453ea95d517 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:32.497409 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-152d7f66-6710-430b-8890-d453ea95d517 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:32.506683 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-152d7f66-6710-430b-8890-d453ea95d517 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51" status: 200 len: 1267 microversion: 2.1 time: 0.216357 Aug 09 11:26:32.516657 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 542/1058] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:32 2022] GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51 => generated 1267 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:33.533160 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-35ed757e-ca36-4084-bdfe-63d1fe2cb1d3 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:33.533831 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-35ed757e-ca36-4084-bdfe-63d1fe2cb1d3 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 26cff99f-ec69-43f4-b0be-dda5ce2ccd51] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:33.542603 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-35ed757e-ca36-4084-bdfe-63d1fe2cb1d3 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:33.543507 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-35ed757e-ca36-4084-bdfe-63d1fe2cb1d3 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:33.544096 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-35ed757e-ca36-4084-bdfe-63d1fe2cb1d3 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:33.544999 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-35ed757e-ca36-4084-bdfe-63d1fe2cb1d3 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:33.545775 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-35ed757e-ca36-4084-bdfe-63d1fe2cb1d3 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:33.546730 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-35ed757e-ca36-4084-bdfe-63d1fe2cb1d3 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:33.966225 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-35ed757e-ca36-4084-bdfe-63d1fe2cb1d3 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:33.982173 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-35ed757e-ca36-4084-bdfe-63d1fe2cb1d3 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51" status: 200 len: 1267 microversion: 2.1 time: 0.456656 Aug 09 11:26:33.995030 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 517/1059] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:33 2022] GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51 => generated 1267 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:33.995279 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-1be47793-bcd5-4465-a01d-bc5620ad622c req-3dbc70e0-bf3a-4514-ad7c-53685cbed5d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26cff99f-ec69-43f4-b0be-dda5ce2ccd51", "name": "network-vif-plugged", "status": "completed", "tag": "78730e1b-ce01-4a35-9f7e-01c214a347ad"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:26:34.005940 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-1be47793-bcd5-4465-a01d-bc5620ad622c req-3dbc70e0-bf3a-4514-ad7c-53685cbed5d6 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:34.006432 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-1be47793-bcd5-4465-a01d-bc5620ad622c req-3dbc70e0-bf3a-4514-ad7c-53685cbed5d6 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:34.007107 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-1be47793-bcd5-4465-a01d-bc5620ad622c req-3dbc70e0-bf3a-4514-ad7c-53685cbed5d6 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:34.029420 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-1be47793-bcd5-4465-a01d-bc5620ad622c req-3dbc70e0-bf3a-4514-ad7c-53685cbed5d6 service nova] Creating event network-vif-plugged:78730e1b-ce01-4a35-9f7e-01c214a347ad for instance 26cff99f-ec69-43f4-b0be-dda5ce2ccd51 on hv-cinder-85251 Aug 09 11:26:34.039117 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-1be47793-bcd5-4465-a01d-bc5620ad622c req-3dbc70e0-bf3a-4514-ad7c-53685cbed5d6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055355 Aug 09 11:26:34.042242 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 543/1060] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:26:35.003542 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-57f2020c-920d-4085-922e-e4d6114e1cf5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:35.004146 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-57f2020c-920d-4085-922e-e4d6114e1cf5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 26cff99f-ec69-43f4-b0be-dda5ce2ccd51] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:35.010889 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-57f2020c-920d-4085-922e-e4d6114e1cf5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:35.011732 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-57f2020c-920d-4085-922e-e4d6114e1cf5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:35.012385 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-57f2020c-920d-4085-922e-e4d6114e1cf5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:35.013397 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-57f2020c-920d-4085-922e-e4d6114e1cf5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:35.013847 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-57f2020c-920d-4085-922e-e4d6114e1cf5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:35.014245 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-57f2020c-920d-4085-922e-e4d6114e1cf5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:35.239853 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-57f2020c-920d-4085-922e-e4d6114e1cf5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:35.260976 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-57f2020c-920d-4085-922e-e4d6114e1cf5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51" status: 200 len: 1267 microversion: 2.1 time: 0.253000 Aug 09 11:26:35.263125 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 518/1061] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:34 2022] GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51 => generated 1267 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:36.287673 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-3c460afd-d502-4120-a134-c4ddbd6d0376 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:36.290740 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-3c460afd-d502-4120-a134-c4ddbd6d0376 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 26cff99f-ec69-43f4-b0be-dda5ce2ccd51] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:36.310684 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3c460afd-d502-4120-a134-c4ddbd6d0376 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:36.311226 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3c460afd-d502-4120-a134-c4ddbd6d0376 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:36.311675 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3c460afd-d502-4120-a134-c4ddbd6d0376 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:36.312428 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3c460afd-d502-4120-a134-c4ddbd6d0376 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:36.315559 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3c460afd-d502-4120-a134-c4ddbd6d0376 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:36.316011 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3c460afd-d502-4120-a134-c4ddbd6d0376 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:36.525161 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-3c460afd-d502-4120-a134-c4ddbd6d0376 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:36.538653 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-3c460afd-d502-4120-a134-c4ddbd6d0376 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51" status: 200 len: 1454 microversion: 2.1 time: 0.258689 Aug 09 11:26:36.558281 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 544/1062] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:36 2022] GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51 => generated 1454 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:36.566121 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-6288ec56-d0ea-4bf9-81d2-774ea3d4916d tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:36.566121 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-6288ec56-d0ea-4bf9-81d2-774ea3d4916d tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 26cff99f-ec69-43f4-b0be-dda5ce2ccd51] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:36.594847 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6288ec56-d0ea-4bf9-81d2-774ea3d4916d tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:36.595350 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6288ec56-d0ea-4bf9-81d2-774ea3d4916d tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:36.595844 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6288ec56-d0ea-4bf9-81d2-774ea3d4916d tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:36.598831 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6288ec56-d0ea-4bf9-81d2-774ea3d4916d tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:36.604884 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6288ec56-d0ea-4bf9-81d2-774ea3d4916d tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:36.607973 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6288ec56-d0ea-4bf9-81d2-774ea3d4916d tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:36.878431 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-6288ec56-d0ea-4bf9-81d2-774ea3d4916d tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:36.894495 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-6288ec56-d0ea-4bf9-81d2-774ea3d4916d tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51" status: 200 len: 1454 microversion: 2.1 time: 0.335755 Aug 09 11:26:36.896031 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 519/1063] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:36 2022] GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51 => generated 1454 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:40.336578 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-6d8ced01-de75-4cae-82cc-decda9a21daa req-d50adcbe-2c24-450e-bffd-dc1cfa7dc6bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26cff99f-ec69-43f4-b0be-dda5ce2ccd51", "tag": "78730e1b-ce01-4a35-9f7e-01c214a347ad"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:26:40.347484 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-6d8ced01-de75-4cae-82cc-decda9a21daa req-d50adcbe-2c24-450e-bffd-dc1cfa7dc6bd service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:40.347959 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-6d8ced01-de75-4cae-82cc-decda9a21daa req-d50adcbe-2c24-450e-bffd-dc1cfa7dc6bd service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:40.348411 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-6d8ced01-de75-4cae-82cc-decda9a21daa req-d50adcbe-2c24-450e-bffd-dc1cfa7dc6bd service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:40.369678 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-6d8ced01-de75-4cae-82cc-decda9a21daa req-d50adcbe-2c24-450e-bffd-dc1cfa7dc6bd service nova] Creating event network-changed:78730e1b-ce01-4a35-9f7e-01c214a347ad for instance 26cff99f-ec69-43f4-b0be-dda5ce2ccd51 on hv-cinder-85251 Aug 09 11:26:40.381396 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-6d8ced01-de75-4cae-82cc-decda9a21daa req-d50adcbe-2c24-450e-bffd-dc1cfa7dc6bd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048449 Aug 09 11:26:40.382000 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 545/1064] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:26:56.087800 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-1ceab80c-bf8e-46a2-9949-a4faca18c538 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Action: 'create', calling method: .version_select at 0x7f2821fedd30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1294905069", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHi+5svzUzo3BWjU3ueXjhWqnvaVkmo8n5Xo40R987RxKDJ0lq9Gy0LSFk3HX6IILv9hh/GZ/lgJQvJR4fiBxHwJ0vHO72c4el6hx03AnCpvkCCsgsclwXPojH+xjgz8MA=="}} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:26:56.093629 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_api:SELECT=11 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:56.094288 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell1:SELECT=35 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:56.107398 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.quota [None req-1ceab80c-bf8e-46a2-9949-a4faca18c538 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Getting quotas for project 2b3b0a56e9724ccd81df765dfc49739d. Resources: {'key_pairs'} {{(pid=117684) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:26:56.111648 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.quota [None req-1ceab80c-bf8e-46a2-9949-a4faca18c538 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Getting quotas for user 909eaedf75674f88b41cbdc0eac33964 and project 2b3b0a56e9724ccd81df765dfc49739d. Resources: {'key_pairs'} {{(pid=117684) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:26:56.136240 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-1ceab80c-bf8e-46a2-9949-a4faca18c538 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.053003 Aug 09 11:26:56.137093 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 520/1065] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 9 11:26:56 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:26:56.248667 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_api:SELECT=13 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:56.249592 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell1:SELECT=33 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:56.253995 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-92e7563f-2482-4380-a91b-62bb78d33d35 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-699164113", "imageRef": "63b71550-6a24-4c95-aad2-f41ba06aa9fc", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1294905069", "networks": [{"uuid": "d3227a0b-e20a-4651-92a0-f58385c9c7f2"}]}} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:26:56.330664 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.network.neutron [None req-92e7563f-2482-4380-a91b-62bb78d33d35 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] validate_networks() for [('d3227a0b-e20a-4651-92a0-f58385c9c7f2', None, None, None, None, None)] {{(pid=117685) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 11:26:56.751805 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-92e7563f-2482-4380-a91b-62bb78d33d35 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Flavor limits 0:0:0 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 11:26:56.752196 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-92e7563f-2482-4380-a91b-62bb78d33d35 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Image limits 0:0:0 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 11:26:56.752698 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-92e7563f-2482-4380-a91b-62bb78d33d35 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Flavor pref 0:0:0 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 11:26:56.753207 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-92e7563f-2482-4380-a91b-62bb78d33d35 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Image pref 0:0:0 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 11:26:56.753508 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-92e7563f-2482-4380-a91b-62bb78d33d35 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 11:26:56.763558 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-92e7563f-2482-4380-a91b-62bb78d33d35 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:56.764423 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-92e7563f-2482-4380-a91b-62bb78d33d35 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:56.764842 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-92e7563f-2482-4380-a91b-62bb78d33d35 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:56.765965 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-92e7563f-2482-4380-a91b-62bb78d33d35 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:56.766250 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-92e7563f-2482-4380-a91b-62bb78d33d35 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:56.766804 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-92e7563f-2482-4380-a91b-62bb78d33d35 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:56.786230 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.quota [None req-92e7563f-2482-4380-a91b-62bb78d33d35 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Getting quotas for project 2b3b0a56e9724ccd81df765dfc49739d. Resources: {'cores', 'instances', 'ram'} {{(pid=117685) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:26:56.791430 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.quota [None req-92e7563f-2482-4380-a91b-62bb78d33d35 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Getting quotas for user 909eaedf75674f88b41cbdc0eac33964 and project 2b3b0a56e9724ccd81df765dfc49739d. Resources: {'cores', 'instances', 'ram'} {{(pid=117685) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:26:56.808860 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-92e7563f-2482-4380-a91b-62bb78d33d35 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Going to run 1 instances... {{(pid=117685) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 11:26:56.811775 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-92e7563f-2482-4380-a91b-62bb78d33d35 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] [instance: 9020822d-a8c7-4fe5-a322-0be8f8148d52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='63b71550-6a24-4c95-aad2-f41ba06aa9fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117685) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 11:26:56.864208 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-92e7563f-2482-4380-a91b-62bb78d33d35 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.617113 Aug 09 11:26:56.865419 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 546/1066] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 9 11:26:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 11:26:56.876195 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-c9c69ca4-c5df-48fd-b3e4-e872940adb0e tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:56.877049 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-c9c69ca4-c5df-48fd-b3e4-e872940adb0e tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] [instance: 9020822d-a8c7-4fe5-a322-0be8f8148d52] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:56.991563 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-c9c69ca4-c5df-48fd-b3e4-e872940adb0e tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909eaedf75674f88b41cbdc0eac33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b0a56e9724ccd81df765dfc49739d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:57.002720 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-c9c69ca4-c5df-48fd-b3e4-e872940adb0e tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52" status: 200 len: 1258 microversion: 2.1 time: 0.130550 Aug 09 11:26:57.017397 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 521/1067] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:56 2022] GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52 => generated 1258 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:58.023470 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-89c4160d-26d1-4a59-aa9f-c53ecde6b3b2 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:58.025261 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-89c4160d-26d1-4a59-aa9f-c53ecde6b3b2 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] [instance: 9020822d-a8c7-4fe5-a322-0be8f8148d52] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:58.033164 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-89c4160d-26d1-4a59-aa9f-c53ecde6b3b2 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:58.033647 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-89c4160d-26d1-4a59-aa9f-c53ecde6b3b2 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:58.034258 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-89c4160d-26d1-4a59-aa9f-c53ecde6b3b2 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:58.035149 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-89c4160d-26d1-4a59-aa9f-c53ecde6b3b2 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:58.035630 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-89c4160d-26d1-4a59-aa9f-c53ecde6b3b2 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:58.036024 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-89c4160d-26d1-4a59-aa9f-c53ecde6b3b2 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:58.103474 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-89c4160d-26d1-4a59-aa9f-c53ecde6b3b2 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909eaedf75674f88b41cbdc0eac33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b0a56e9724ccd81df765dfc49739d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:58.111416 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-89c4160d-26d1-4a59-aa9f-c53ecde6b3b2 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52" status: 200 len: 1310 microversion: 2.1 time: 0.092101 Aug 09 11:26:58.112206 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 547/1068] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:58 2022] GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52 => generated 1310 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:59.133001 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-56e7f65a-78d1-48b6-8a91-932dbb1ea662 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:59.133698 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-56e7f65a-78d1-48b6-8a91-932dbb1ea662 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] [instance: 9020822d-a8c7-4fe5-a322-0be8f8148d52] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:59.144218 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-56e7f65a-78d1-48b6-8a91-932dbb1ea662 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:59.144987 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-56e7f65a-78d1-48b6-8a91-932dbb1ea662 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:59.145580 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-56e7f65a-78d1-48b6-8a91-932dbb1ea662 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:59.146468 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-56e7f65a-78d1-48b6-8a91-932dbb1ea662 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:59.147290 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-56e7f65a-78d1-48b6-8a91-932dbb1ea662 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:59.147892 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-56e7f65a-78d1-48b6-8a91-932dbb1ea662 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:59.223959 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-56e7f65a-78d1-48b6-8a91-932dbb1ea662 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909eaedf75674f88b41cbdc0eac33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b0a56e9724ccd81df765dfc49739d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:59.231966 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-56e7f65a-78d1-48b6-8a91-932dbb1ea662 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52" status: 200 len: 1316 microversion: 2.1 time: 0.102993 Aug 09 11:26:59.232659 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 522/1069] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:59 2022] GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52 => generated 1316 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:00.253147 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-4eebcac1-486c-4929-9ae3-be18acfec05d tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:00.253764 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-4eebcac1-486c-4929-9ae3-be18acfec05d tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] [instance: 9020822d-a8c7-4fe5-a322-0be8f8148d52] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:00.261232 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4eebcac1-486c-4929-9ae3-be18acfec05d tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:00.262004 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4eebcac1-486c-4929-9ae3-be18acfec05d tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:00.262465 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4eebcac1-486c-4929-9ae3-be18acfec05d tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:00.263168 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4eebcac1-486c-4929-9ae3-be18acfec05d tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:00.263615 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4eebcac1-486c-4929-9ae3-be18acfec05d tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:00.264710 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-4eebcac1-486c-4929-9ae3-be18acfec05d tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:00.408511 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-4eebcac1-486c-4929-9ae3-be18acfec05d tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909eaedf75674f88b41cbdc0eac33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b0a56e9724ccd81df765dfc49739d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:00.419578 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-4eebcac1-486c-4929-9ae3-be18acfec05d tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52" status: 200 len: 1358 microversion: 2.1 time: 0.170293 Aug 09 11:27:00.420539 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 548/1070] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:00 2022] GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:01.441453 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-8532735b-5f28-45fd-84ef-9e7d8f7561ad tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:01.442132 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-8532735b-5f28-45fd-84ef-9e7d8f7561ad tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] [instance: 9020822d-a8c7-4fe5-a322-0be8f8148d52] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:01.449083 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8532735b-5f28-45fd-84ef-9e7d8f7561ad tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:01.449564 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8532735b-5f28-45fd-84ef-9e7d8f7561ad tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:01.450201 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8532735b-5f28-45fd-84ef-9e7d8f7561ad tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:01.450895 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8532735b-5f28-45fd-84ef-9e7d8f7561ad tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:01.451498 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8532735b-5f28-45fd-84ef-9e7d8f7561ad tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:01.452089 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8532735b-5f28-45fd-84ef-9e7d8f7561ad tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:01.598463 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-8532735b-5f28-45fd-84ef-9e7d8f7561ad tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909eaedf75674f88b41cbdc0eac33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b0a56e9724ccd81df765dfc49739d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:01.607553 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-8532735b-5f28-45fd-84ef-9e7d8f7561ad tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52" status: 200 len: 1358 microversion: 2.1 time: 0.170438 Aug 09 11:27:01.608170 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 523/1071] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:01 2022] GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:02.629660 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-21315dbc-a519-4ebf-9bbf-6ed8e54b3a11 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:02.630298 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-21315dbc-a519-4ebf-9bbf-6ed8e54b3a11 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] [instance: 9020822d-a8c7-4fe5-a322-0be8f8148d52] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:02.637814 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-21315dbc-a519-4ebf-9bbf-6ed8e54b3a11 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:02.638303 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-21315dbc-a519-4ebf-9bbf-6ed8e54b3a11 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:02.638750 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-21315dbc-a519-4ebf-9bbf-6ed8e54b3a11 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:02.639516 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-21315dbc-a519-4ebf-9bbf-6ed8e54b3a11 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:02.639964 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-21315dbc-a519-4ebf-9bbf-6ed8e54b3a11 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:02.640420 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-21315dbc-a519-4ebf-9bbf-6ed8e54b3a11 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:02.793528 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-21315dbc-a519-4ebf-9bbf-6ed8e54b3a11 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909eaedf75674f88b41cbdc0eac33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b0a56e9724ccd81df765dfc49739d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:02.802158 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-21315dbc-a519-4ebf-9bbf-6ed8e54b3a11 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52" status: 200 len: 1358 microversion: 2.1 time: 0.176323 Aug 09 11:27:02.802926 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 549/1072] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:02 2022] GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:03.823380 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-852cc90d-f794-4989-ad8b-b8859a8b2027 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:03.824102 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-852cc90d-f794-4989-ad8b-b8859a8b2027 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] [instance: 9020822d-a8c7-4fe5-a322-0be8f8148d52] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:03.831731 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-852cc90d-f794-4989-ad8b-b8859a8b2027 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:03.832674 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-852cc90d-f794-4989-ad8b-b8859a8b2027 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:03.833438 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-852cc90d-f794-4989-ad8b-b8859a8b2027 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:03.834672 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-852cc90d-f794-4989-ad8b-b8859a8b2027 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:03.835198 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-852cc90d-f794-4989-ad8b-b8859a8b2027 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:03.835689 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-852cc90d-f794-4989-ad8b-b8859a8b2027 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:03.993854 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-852cc90d-f794-4989-ad8b-b8859a8b2027 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909eaedf75674f88b41cbdc0eac33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b0a56e9724ccd81df765dfc49739d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:04.007419 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-852cc90d-f794-4989-ad8b-b8859a8b2027 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52" status: 200 len: 1358 microversion: 2.1 time: 0.187922 Aug 09 11:27:04.016085 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 524/1073] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:03 2022] GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52 => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:05.029511 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-2932abf3-2552-4a80-b3ae-9fe4a556725b tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:05.030123 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-2932abf3-2552-4a80-b3ae-9fe4a556725b tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] [instance: 9020822d-a8c7-4fe5-a322-0be8f8148d52] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:05.036781 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2932abf3-2552-4a80-b3ae-9fe4a556725b tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:05.037269 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2932abf3-2552-4a80-b3ae-9fe4a556725b tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:05.037697 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2932abf3-2552-4a80-b3ae-9fe4a556725b tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:05.039435 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2932abf3-2552-4a80-b3ae-9fe4a556725b tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:05.040216 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2932abf3-2552-4a80-b3ae-9fe4a556725b tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:05.041137 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-2932abf3-2552-4a80-b3ae-9fe4a556725b tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:05.218976 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-2932abf3-2552-4a80-b3ae-9fe4a556725b tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909eaedf75674f88b41cbdc0eac33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b0a56e9724ccd81df765dfc49739d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:05.226525 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-2932abf3-2552-4a80-b3ae-9fe4a556725b tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52" status: 200 len: 1358 microversion: 2.1 time: 0.200935 Aug 09 11:27:05.227299 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 550/1074] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:05 2022] GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52 => generated 1358 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:06.248744 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-4bc27950-3216-4f46-b50a-b1fc13721b8c tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:06.249397 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-4bc27950-3216-4f46-b50a-b1fc13721b8c tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] [instance: 9020822d-a8c7-4fe5-a322-0be8f8148d52] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:06.259023 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4bc27950-3216-4f46-b50a-b1fc13721b8c tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:06.259594 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4bc27950-3216-4f46-b50a-b1fc13721b8c tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:06.260577 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4bc27950-3216-4f46-b50a-b1fc13721b8c tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:06.260823 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4bc27950-3216-4f46-b50a-b1fc13721b8c tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:06.261315 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4bc27950-3216-4f46-b50a-b1fc13721b8c tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:06.261677 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4bc27950-3216-4f46-b50a-b1fc13721b8c tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:06.408559 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-4bc27950-3216-4f46-b50a-b1fc13721b8c tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909eaedf75674f88b41cbdc0eac33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b0a56e9724ccd81df765dfc49739d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:06.417034 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-4bc27950-3216-4f46-b50a-b1fc13721b8c tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52" status: 200 len: 1358 microversion: 2.1 time: 0.173203 Aug 09 11:27:06.430612 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 525/1075] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:06 2022] GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:07.440640 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-67677e5d-c16a-47dc-a761-bd840cfde09f tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:07.442914 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-67677e5d-c16a-47dc-a761-bd840cfde09f tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] [instance: 9020822d-a8c7-4fe5-a322-0be8f8148d52] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:07.450607 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell0:SELECT=2 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:07.451579 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell0:SELECT=6 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:07.453870 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-67677e5d-c16a-47dc-a761-bd840cfde09f tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:07.454614 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-67677e5d-c16a-47dc-a761-bd840cfde09f tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:07.455100 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-67677e5d-c16a-47dc-a761-bd840cfde09f tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:07.456005 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-67677e5d-c16a-47dc-a761-bd840cfde09f tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:07.456681 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-67677e5d-c16a-47dc-a761-bd840cfde09f tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:07.457428 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-67677e5d-c16a-47dc-a761-bd840cfde09f tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:07.644780 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-67677e5d-c16a-47dc-a761-bd840cfde09f tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909eaedf75674f88b41cbdc0eac33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b0a56e9724ccd81df765dfc49739d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:07.664099 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-67677e5d-c16a-47dc-a761-bd840cfde09f tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52" status: 200 len: 1358 microversion: 2.1 time: 0.228353 Aug 09 11:27:07.665400 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 551/1076] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:07 2022] GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52 => generated 1358 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:27:07.927332 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [req-bea0d9d8-e4fc-4610-b57a-75ed42c3b436 req-c1b56f9b-5b7c-46a7-9a46-520732437a68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9020822d-a8c7-4fe5-a322-0be8f8148d52", "tag": "2dac4157-7a6b-4a3a-9472-72b1cce67e96"}]} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:27:07.937663 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell0:SELECT=6 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:07.943848 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-bea0d9d8-e4fc-4610-b57a-75ed42c3b436 req-c1b56f9b-5b7c-46a7-9a46-520732437a68 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:07.944587 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-bea0d9d8-e4fc-4610-b57a-75ed42c3b436 req-c1b56f9b-5b7c-46a7-9a46-520732437a68 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:07.945015 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-bea0d9d8-e4fc-4610-b57a-75ed42c3b436 req-c1b56f9b-5b7c-46a7-9a46-520732437a68 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:07.957986 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.compute.server_external_events [req-bea0d9d8-e4fc-4610-b57a-75ed42c3b436 req-c1b56f9b-5b7c-46a7-9a46-520732437a68 service nova] Creating event network-changed:2dac4157-7a6b-4a3a-9472-72b1cce67e96 for instance 9020822d-a8c7-4fe5-a322-0be8f8148d52 on hv-cinder-85251 Aug 09 11:27:07.963288 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [req-bea0d9d8-e4fc-4610-b57a-75ed42c3b436 req-c1b56f9b-5b7c-46a7-9a46-520732437a68 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040154 Aug 09 11:27:07.964127 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 526/1077] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:27:08.685443 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-23901851-d3c0-4b69-b86a-2f5ed6b0b826 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:08.686148 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-23901851-d3c0-4b69-b86a-2f5ed6b0b826 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] [instance: 9020822d-a8c7-4fe5-a322-0be8f8148d52] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:08.692957 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-23901851-d3c0-4b69-b86a-2f5ed6b0b826 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:08.693433 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-23901851-d3c0-4b69-b86a-2f5ed6b0b826 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:08.693859 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-23901851-d3c0-4b69-b86a-2f5ed6b0b826 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:08.694543 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-23901851-d3c0-4b69-b86a-2f5ed6b0b826 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:08.694986 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-23901851-d3c0-4b69-b86a-2f5ed6b0b826 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:08.695398 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-23901851-d3c0-4b69-b86a-2f5ed6b0b826 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:08.836166 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-23901851-d3c0-4b69-b86a-2f5ed6b0b826 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909eaedf75674f88b41cbdc0eac33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b0a56e9724ccd81df765dfc49739d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:08.844255 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-23901851-d3c0-4b69-b86a-2f5ed6b0b826 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52" status: 200 len: 1358 microversion: 2.1 time: 0.162903 Aug 09 11:27:08.844863 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 552/1078] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:08 2022] GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:09.866668 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-8604f338-b5e2-44b5-b95f-8423242d33d2 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:09.867330 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-8604f338-b5e2-44b5-b95f-8423242d33d2 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] [instance: 9020822d-a8c7-4fe5-a322-0be8f8148d52] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:09.873778 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8604f338-b5e2-44b5-b95f-8423242d33d2 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:09.874322 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8604f338-b5e2-44b5-b95f-8423242d33d2 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:09.874756 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8604f338-b5e2-44b5-b95f-8423242d33d2 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:09.875447 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8604f338-b5e2-44b5-b95f-8423242d33d2 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:09.875891 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8604f338-b5e2-44b5-b95f-8423242d33d2 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:09.876304 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8604f338-b5e2-44b5-b95f-8423242d33d2 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:10.021535 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-8604f338-b5e2-44b5-b95f-8423242d33d2 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909eaedf75674f88b41cbdc0eac33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b0a56e9724ccd81df765dfc49739d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:10.033692 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-8604f338-b5e2-44b5-b95f-8423242d33d2 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52" status: 200 len: 1358 microversion: 2.1 time: 0.171449 Aug 09 11:27:10.034445 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 527/1079] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:09 2022] GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:11.058481 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-bbf0660f-29d6-4eec-853b-db95dcccc2d9 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:11.059152 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-bbf0660f-29d6-4eec-853b-db95dcccc2d9 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] [instance: 9020822d-a8c7-4fe5-a322-0be8f8148d52] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:11.066954 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bbf0660f-29d6-4eec-853b-db95dcccc2d9 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:11.067483 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bbf0660f-29d6-4eec-853b-db95dcccc2d9 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:11.067965 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bbf0660f-29d6-4eec-853b-db95dcccc2d9 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:11.068758 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bbf0660f-29d6-4eec-853b-db95dcccc2d9 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:11.069248 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bbf0660f-29d6-4eec-853b-db95dcccc2d9 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:11.069705 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-bbf0660f-29d6-4eec-853b-db95dcccc2d9 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:11.202557 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-bbf0660f-29d6-4eec-853b-db95dcccc2d9 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909eaedf75674f88b41cbdc0eac33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b0a56e9724ccd81df765dfc49739d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:11.213783 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-bbf0660f-29d6-4eec-853b-db95dcccc2d9 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52" status: 200 len: 1358 microversion: 2.1 time: 0.160941 Aug 09 11:27:11.214827 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 553/1080] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:11 2022] GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:12.239909 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-4995b459-7675-4669-bd86-fb6927f27fb2 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:12.240917 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-4995b459-7675-4669-bd86-fb6927f27fb2 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] [instance: 9020822d-a8c7-4fe5-a322-0be8f8148d52] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:12.251590 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4995b459-7675-4669-bd86-fb6927f27fb2 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:12.252455 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4995b459-7675-4669-bd86-fb6927f27fb2 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:12.253169 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4995b459-7675-4669-bd86-fb6927f27fb2 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:12.254349 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4995b459-7675-4669-bd86-fb6927f27fb2 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:12.255103 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4995b459-7675-4669-bd86-fb6927f27fb2 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:12.255811 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4995b459-7675-4669-bd86-fb6927f27fb2 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:12.390572 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-4995b459-7675-4669-bd86-fb6927f27fb2 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909eaedf75674f88b41cbdc0eac33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b0a56e9724ccd81df765dfc49739d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:12.398241 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-4995b459-7675-4669-bd86-fb6927f27fb2 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52" status: 200 len: 1358 microversion: 2.1 time: 0.165003 Aug 09 11:27:12.398844 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 528/1081] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:12 2022] GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:13.427874 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-90116579-70c1-424b-8804-b62aa1382cd8 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:13.428667 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-90116579-70c1-424b-8804-b62aa1382cd8 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] [instance: 9020822d-a8c7-4fe5-a322-0be8f8148d52] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:13.436945 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-90116579-70c1-424b-8804-b62aa1382cd8 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:13.437427 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-90116579-70c1-424b-8804-b62aa1382cd8 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:13.437851 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-90116579-70c1-424b-8804-b62aa1382cd8 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:13.438543 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-90116579-70c1-424b-8804-b62aa1382cd8 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:13.438987 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-90116579-70c1-424b-8804-b62aa1382cd8 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:13.439395 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-90116579-70c1-424b-8804-b62aa1382cd8 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:13.545996 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [req-43458729-a6dc-4a02-823c-245c16f4f93e req-c476f7ad-cf7b-4b25-a127-f1c8b7c05198 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9020822d-a8c7-4fe5-a322-0be8f8148d52", "name": "network-vif-plugged", "status": "completed", "tag": "2dac4157-7a6b-4a3a-9472-72b1cce67e96"}]} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:27:13.557287 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-43458729-a6dc-4a02-823c-245c16f4f93e req-c476f7ad-cf7b-4b25-a127-f1c8b7c05198 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:13.557882 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-43458729-a6dc-4a02-823c-245c16f4f93e req-c476f7ad-cf7b-4b25-a127-f1c8b7c05198 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:13.558668 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-43458729-a6dc-4a02-823c-245c16f4f93e req-c476f7ad-cf7b-4b25-a127-f1c8b7c05198 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:13.571811 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.compute.server_external_events [req-43458729-a6dc-4a02-823c-245c16f4f93e req-c476f7ad-cf7b-4b25-a127-f1c8b7c05198 service nova] Creating event network-vif-plugged:2dac4157-7a6b-4a3a-9472-72b1cce67e96 for instance 9020822d-a8c7-4fe5-a322-0be8f8148d52 on hv-cinder-85251 Aug 09 11:27:13.575705 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-90116579-70c1-424b-8804-b62aa1382cd8 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909eaedf75674f88b41cbdc0eac33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b0a56e9724ccd81df765dfc49739d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:13.577739 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [req-43458729-a6dc-4a02-823c-245c16f4f93e req-c476f7ad-cf7b-4b25-a127-f1c8b7c05198 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035259 Aug 09 11:27:13.578309 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 529/1082] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:27:13.584757 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-90116579-70c1-424b-8804-b62aa1382cd8 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52" status: 200 len: 1358 microversion: 2.1 time: 0.161767 Aug 09 11:27:13.585402 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 554/1083] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:13 2022] GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:14.610613 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-46eab932-b000-43f5-a231-80d7129d5676 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:14.611755 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-46eab932-b000-43f5-a231-80d7129d5676 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] [instance: 9020822d-a8c7-4fe5-a322-0be8f8148d52] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:14.622332 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-46eab932-b000-43f5-a231-80d7129d5676 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:14.622969 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-46eab932-b000-43f5-a231-80d7129d5676 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:14.623393 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-46eab932-b000-43f5-a231-80d7129d5676 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:14.624075 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-46eab932-b000-43f5-a231-80d7129d5676 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:14.624560 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-46eab932-b000-43f5-a231-80d7129d5676 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:14.624976 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-46eab932-b000-43f5-a231-80d7129d5676 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:14.763624 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-46eab932-b000-43f5-a231-80d7129d5676 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909eaedf75674f88b41cbdc0eac33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b0a56e9724ccd81df765dfc49739d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:14.775125 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-46eab932-b000-43f5-a231-80d7129d5676 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52" status: 200 len: 1358 microversion: 2.1 time: 0.171606 Aug 09 11:27:14.775864 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 530/1084] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:14 2022] GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:15.801123 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-953cb4f8-bdc6-44ca-b44c-975602ee2747 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:15.802357 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-953cb4f8-bdc6-44ca-b44c-975602ee2747 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] [instance: 9020822d-a8c7-4fe5-a322-0be8f8148d52] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:15.814283 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-953cb4f8-bdc6-44ca-b44c-975602ee2747 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:15.815085 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-953cb4f8-bdc6-44ca-b44c-975602ee2747 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:15.815806 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-953cb4f8-bdc6-44ca-b44c-975602ee2747 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:15.817012 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-953cb4f8-bdc6-44ca-b44c-975602ee2747 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:15.817765 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-953cb4f8-bdc6-44ca-b44c-975602ee2747 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:15.818470 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-953cb4f8-bdc6-44ca-b44c-975602ee2747 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:15.969835 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-953cb4f8-bdc6-44ca-b44c-975602ee2747 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909eaedf75674f88b41cbdc0eac33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b0a56e9724ccd81df765dfc49739d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:15.980424 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-953cb4f8-bdc6-44ca-b44c-975602ee2747 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52" status: 200 len: 1547 microversion: 2.1 time: 0.185441 Aug 09 11:27:15.981305 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 555/1085] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:15 2022] GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52 => generated 1547 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:16.001533 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-9f451aa7-6d53-4ba0-ae32-b077e6065688 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:16.002114 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-9f451aa7-6d53-4ba0-ae32-b077e6065688 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] [instance: 9020822d-a8c7-4fe5-a322-0be8f8148d52] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:16.008957 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9f451aa7-6d53-4ba0-ae32-b077e6065688 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:16.009471 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9f451aa7-6d53-4ba0-ae32-b077e6065688 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:16.009875 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9f451aa7-6d53-4ba0-ae32-b077e6065688 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:16.010575 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9f451aa7-6d53-4ba0-ae32-b077e6065688 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:16.011027 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9f451aa7-6d53-4ba0-ae32-b077e6065688 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:16.011848 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-9f451aa7-6d53-4ba0-ae32-b077e6065688 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:16.163349 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-9f451aa7-6d53-4ba0-ae32-b077e6065688 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909eaedf75674f88b41cbdc0eac33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b0a56e9724ccd81df765dfc49739d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:16.171547 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-9f451aa7-6d53-4ba0-ae32-b077e6065688 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52" status: 200 len: 1547 microversion: 2.1 time: 0.173982 Aug 09 11:27:16.172114 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 531/1086] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:15 2022] GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52 => generated 1547 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:27:16.191762 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-88efb618-8b9f-483b-8a18-b14b12a2816e tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:16.196560 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-88efb618-8b9f-483b-8a18-b14b12a2816e tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '909eaedf75674f88b41cbdc0eac33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b0a56e9724ccd81df765dfc49739d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:16.197323 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-88efb618-8b9f-483b-8a18-b14b12a2816e tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Searching by: {'deleted': False, 'project_id': '2b3b0a56e9724ccd81df765dfc49739d'} {{(pid=117685) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 11:27:16.204074 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-88efb618-8b9f-483b-8a18-b14b12a2816e tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:16.204587 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-88efb618-8b9f-483b-8a18-b14b12a2816e tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:16.205014 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-88efb618-8b9f-483b-8a18-b14b12a2816e tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:16.205722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-88efb618-8b9f-483b-8a18-b14b12a2816e tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:16.206160 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-88efb618-8b9f-483b-8a18-b14b12a2816e tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:16.206575 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-88efb618-8b9f-483b-8a18-b14b12a2816e tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:16.310213 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.multi_cell_list [None req-88efb618-8b9f-483b-8a18-b14b12a2816e tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117685) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 11:27:16.407039 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-88efb618-8b9f-483b-8a18-b14b12a2816e tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.218947 Aug 09 11:27:16.407527 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 556/1087] 10.222.0.27 () {58 vars in 1125 bytes} [Tue Aug 9 11:27:16 2022] GET /compute/v2.1/servers => generated 342 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:27:16.422009 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-24191463-3f92-4bcb-b200-d20ab2594f01 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:16.422009 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-24191463-3f92-4bcb-b200-d20ab2594f01 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] [instance: 9020822d-a8c7-4fe5-a322-0be8f8148d52] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:16.430083 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-24191463-3f92-4bcb-b200-d20ab2594f01 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:16.430800 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-24191463-3f92-4bcb-b200-d20ab2594f01 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:16.431416 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-24191463-3f92-4bcb-b200-d20ab2594f01 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:16.432504 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-24191463-3f92-4bcb-b200-d20ab2594f01 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:16.433208 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-24191463-3f92-4bcb-b200-d20ab2594f01 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:16.433912 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-24191463-3f92-4bcb-b200-d20ab2594f01 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:16.571264 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-24191463-3f92-4bcb-b200-d20ab2594f01 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909eaedf75674f88b41cbdc0eac33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b0a56e9724ccd81df765dfc49739d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:16.579435 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-24191463-3f92-4bcb-b200-d20ab2594f01 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52" status: 200 len: 1547 microversion: 2.1 time: 0.164085 Aug 09 11:27:16.580013 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 532/1088] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:16 2022] GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52 => generated 1547 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:18.145283 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-684737aa-c7ce-4c22-a7c4-f34b9f23a604 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc7f5501-8780-4eef-bdf1-6377f2024b06"}} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:27:18.148640 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-684737aa-c7ce-4c22-a7c4-f34b9f23a604 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] [instance: 9020822d-a8c7-4fe5-a322-0be8f8148d52] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:18.157344 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-684737aa-c7ce-4c22-a7c4-f34b9f23a604 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:18.157860 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-684737aa-c7ce-4c22-a7c4-f34b9f23a604 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:18.158321 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-684737aa-c7ce-4c22-a7c4-f34b9f23a604 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:18.159015 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-684737aa-c7ce-4c22-a7c4-f34b9f23a604 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:18.159464 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-684737aa-c7ce-4c22-a7c4-f34b9f23a604 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:18.159885 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-684737aa-c7ce-4c22-a7c4-f34b9f23a604 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:18.417092 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-684737aa-c7ce-4c22-a7c4-f34b9f23a604 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "POST /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278036 Aug 09 11:27:18.417730 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 557/1089] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Aug 9 11:27:18 2022] POST /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:27:25.001104 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-21491c50-774d-49cb-8dac-a8596273ae37 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:25.001752 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-21491c50-774d-49cb-8dac-a8596273ae37 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] [instance: 9020822d-a8c7-4fe5-a322-0be8f8148d52] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:25.008889 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-21491c50-774d-49cb-8dac-a8596273ae37 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:25.009433 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-21491c50-774d-49cb-8dac-a8596273ae37 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:25.009877 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-21491c50-774d-49cb-8dac-a8596273ae37 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:25.010569 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-21491c50-774d-49cb-8dac-a8596273ae37 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:25.011021 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-21491c50-774d-49cb-8dac-a8596273ae37 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:25.011443 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-21491c50-774d-49cb-8dac-a8596273ae37 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:25.174299 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-21491c50-774d-49cb-8dac-a8596273ae37 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909eaedf75674f88b41cbdc0eac33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b0a56e9724ccd81df765dfc49739d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:25.183153 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-21491c50-774d-49cb-8dac-a8596273ae37 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52" status: 200 len: 1593 microversion: 2.1 time: 0.186094 Aug 09 11:27:25.183725 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 533/1090] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:24 2022] GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52 => generated 1593 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:27.044515 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell0:SELECT=2 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:27.049681 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-f7f61c79-5294-4d39-9ff6-451d7f0c160d req-af169cd9-ac0c-4b75-b3f7-f92db43c7547 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9020822d-a8c7-4fe5-a322-0be8f8148d52", "tag": "2dac4157-7a6b-4a3a-9472-72b1cce67e96"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:27:27.055675 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:27.060982 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-f7f61c79-5294-4d39-9ff6-451d7f0c160d req-af169cd9-ac0c-4b75-b3f7-f92db43c7547 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:27.061690 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-f7f61c79-5294-4d39-9ff6-451d7f0c160d req-af169cd9-ac0c-4b75-b3f7-f92db43c7547 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:27.062398 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-f7f61c79-5294-4d39-9ff6-451d7f0c160d req-af169cd9-ac0c-4b75-b3f7-f92db43c7547 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:27.067096 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:27.075505 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-f7f61c79-5294-4d39-9ff6-451d7f0c160d req-af169cd9-ac0c-4b75-b3f7-f92db43c7547 service nova] Creating event network-changed:2dac4157-7a6b-4a3a-9472-72b1cce67e96 for instance 9020822d-a8c7-4fe5-a322-0be8f8148d52 on hv-cinder-85251 Aug 09 11:27:27.080855 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-f7f61c79-5294-4d39-9ff6-451d7f0c160d req-af169cd9-ac0c-4b75-b3f7-f92db43c7547 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037822 Aug 09 11:27:27.081769 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 558/1091] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:27:28.135095 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-5a48b9d9-66df-4900-ab03-cb3e4d46ff93 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1324635282"}} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:27:28.135672 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-5a48b9d9-66df-4900-ab03-cb3e4d46ff93 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] [instance: 9020822d-a8c7-4fe5-a322-0be8f8148d52] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:28.138228 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:28.145001 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5a48b9d9-66df-4900-ab03-cb3e4d46ff93 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:28.145567 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5a48b9d9-66df-4900-ab03-cb3e4d46ff93 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:28.146001 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5a48b9d9-66df-4900-ab03-cb3e4d46ff93 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:28.146704 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5a48b9d9-66df-4900-ab03-cb3e4d46ff93 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:28.147149 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5a48b9d9-66df-4900-ab03-cb3e4d46ff93 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:28.147569 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5a48b9d9-66df-4900-ab03-cb3e4d46ff93 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:28.152735 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell1:SELECT=65 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:28.279657 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.network.security_group_api [None req-5a48b9d9-66df-4900-ab03-cb3e4d46ff93 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Adding security group 9b869fe3-5f4f-4792-9f05-bd97847ad6fa to port 2dac4157-7a6b-4a3a-9472-72b1cce67e96 Aug 09 11:27:28.618805 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-5a48b9d9-66df-4900-ab03-cb3e4d46ff93 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "POST /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52/action" status: 202 len: 0 microversion: 2.1 time: 0.487645 Aug 09 11:27:28.619758 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 534/1092] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 9 11:27:28 2022] POST /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52/action => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:27:28.629909 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-73c5d0bf-b471-45a2-945f-d94cb21cf2bc tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:28.630806 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-73c5d0bf-b471-45a2-945f-d94cb21cf2bc tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] [instance: 9020822d-a8c7-4fe5-a322-0be8f8148d52] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:28.638946 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-73c5d0bf-b471-45a2-945f-d94cb21cf2bc tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:28.640207 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-73c5d0bf-b471-45a2-945f-d94cb21cf2bc tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:28.640770 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-73c5d0bf-b471-45a2-945f-d94cb21cf2bc tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:28.642351 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-73c5d0bf-b471-45a2-945f-d94cb21cf2bc tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:28.642351 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-73c5d0bf-b471-45a2-945f-d94cb21cf2bc tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:28.642581 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-73c5d0bf-b471-45a2-945f-d94cb21cf2bc tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:28.793329 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-73c5d0bf-b471-45a2-945f-d94cb21cf2bc tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909eaedf75674f88b41cbdc0eac33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b0a56e9724ccd81df765dfc49739d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:28.802334 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-73c5d0bf-b471-45a2-945f-d94cb21cf2bc tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52" status: 200 len: 1759 microversion: 2.1 time: 0.177198 Aug 09 11:27:28.802969 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 559/1093] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:28 2022] GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52 => generated 1759 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:29.095915 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [req-1b2c4939-242e-40a5-8718-97f72a19e249 req-aedf5f8c-e0a5-4230-82f8-d469ade1ef45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9020822d-a8c7-4fe5-a322-0be8f8148d52", "tag": "2dac4157-7a6b-4a3a-9472-72b1cce67e96"}]} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:27:29.106462 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-1b2c4939-242e-40a5-8718-97f72a19e249 req-aedf5f8c-e0a5-4230-82f8-d469ade1ef45 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:29.106928 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-1b2c4939-242e-40a5-8718-97f72a19e249 req-aedf5f8c-e0a5-4230-82f8-d469ade1ef45 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:29.107346 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-1b2c4939-242e-40a5-8718-97f72a19e249 req-aedf5f8c-e0a5-4230-82f8-d469ade1ef45 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:29.119151 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.compute.server_external_events [req-1b2c4939-242e-40a5-8718-97f72a19e249 req-aedf5f8c-e0a5-4230-82f8-d469ade1ef45 service nova] Creating event network-changed:2dac4157-7a6b-4a3a-9472-72b1cce67e96 for instance 9020822d-a8c7-4fe5-a322-0be8f8148d52 on hv-cinder-85251 Aug 09 11:27:29.124502 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [req-1b2c4939-242e-40a5-8718-97f72a19e249 req-aedf5f8c-e0a5-4230-82f8-d469ade1ef45 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032434 Aug 09 11:27:29.125106 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 535/1094] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:27:51.452595 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-12cae1f0-369e-4fe6-9664-db48ccabcf96 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:27:51.454911 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-12cae1f0-369e-4fe6-9664-db48ccabcf96 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] [instance: 9020822d-a8c7-4fe5-a322-0be8f8148d52] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:51.457455 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_api:SELECT=3 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:51.458110 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell1:SELECT=7 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:51.463914 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-12cae1f0-369e-4fe6-9664-db48ccabcf96 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:51.464434 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-12cae1f0-369e-4fe6-9664-db48ccabcf96 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:51.464849 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-12cae1f0-369e-4fe6-9664-db48ccabcf96 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:51.465614 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-12cae1f0-369e-4fe6-9664-db48ccabcf96 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:51.466090 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-12cae1f0-369e-4fe6-9664-db48ccabcf96 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:51.466516 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-12cae1f0-369e-4fe6-9664-db48ccabcf96 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:51.548615 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-12cae1f0-369e-4fe6-9664-db48ccabcf96 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "POST /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52/action" status: 202 len: 0 microversion: 2.1 time: 0.101469 Aug 09 11:27:51.549211 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 560/1095] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 9 11:27:51 2022] POST /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:27:51.555439 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_api:SELECT=3 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:51.556188 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell1:SELECT=5 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:51.560682 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-2c73e797-e139-4af2-8cc4-133605d9f80f tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:51.561381 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-2c73e797-e139-4af2-8cc4-133605d9f80f tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] [instance: 9020822d-a8c7-4fe5-a322-0be8f8148d52] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:51.568545 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2c73e797-e139-4af2-8cc4-133605d9f80f tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:51.569014 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2c73e797-e139-4af2-8cc4-133605d9f80f tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:51.569439 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2c73e797-e139-4af2-8cc4-133605d9f80f tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:51.570129 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2c73e797-e139-4af2-8cc4-133605d9f80f tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:51.570568 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2c73e797-e139-4af2-8cc4-133605d9f80f tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:51.570983 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2c73e797-e139-4af2-8cc4-133605d9f80f tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:51.860016 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-2c73e797-e139-4af2-8cc4-133605d9f80f tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909eaedf75674f88b41cbdc0eac33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b0a56e9724ccd81df765dfc49739d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:51.868199 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-2c73e797-e139-4af2-8cc4-133605d9f80f tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52" status: 200 len: 1751 microversion: 2.1 time: 0.314342 Aug 09 11:27:51.868789 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 536/1096] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:51 2022] GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52 => generated 1751 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:27:52.894047 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-f6c17383-e6fa-48f6-8e26-f37b769f4205 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:52.895216 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-f6c17383-e6fa-48f6-8e26-f37b769f4205 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] [instance: 9020822d-a8c7-4fe5-a322-0be8f8148d52] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:52.905168 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f6c17383-e6fa-48f6-8e26-f37b769f4205 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:52.906402 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f6c17383-e6fa-48f6-8e26-f37b769f4205 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:52.906543 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f6c17383-e6fa-48f6-8e26-f37b769f4205 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:52.907623 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f6c17383-e6fa-48f6-8e26-f37b769f4205 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:52.908429 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f6c17383-e6fa-48f6-8e26-f37b769f4205 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:52.909109 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f6c17383-e6fa-48f6-8e26-f37b769f4205 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:53.121074 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-f6c17383-e6fa-48f6-8e26-f37b769f4205 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909eaedf75674f88b41cbdc0eac33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b0a56e9724ccd81df765dfc49739d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:53.129810 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-f6c17383-e6fa-48f6-8e26-f37b769f4205 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52" status: 200 len: 1756 microversion: 2.1 time: 0.242154 Aug 09 11:27:53.130401 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 561/1097] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:52 2022] GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52 => generated 1756 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:54.158023 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-cfd9b718-00bf-4488-8b64-9de5bc131b28 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:54.158949 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-cfd9b718-00bf-4488-8b64-9de5bc131b28 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] [instance: 9020822d-a8c7-4fe5-a322-0be8f8148d52] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:54.170449 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cfd9b718-00bf-4488-8b64-9de5bc131b28 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:54.171132 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cfd9b718-00bf-4488-8b64-9de5bc131b28 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:54.171839 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cfd9b718-00bf-4488-8b64-9de5bc131b28 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:54.173083 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cfd9b718-00bf-4488-8b64-9de5bc131b28 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:54.173826 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cfd9b718-00bf-4488-8b64-9de5bc131b28 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:54.174519 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cfd9b718-00bf-4488-8b64-9de5bc131b28 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:54.332748 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-cfd9b718-00bf-4488-8b64-9de5bc131b28 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909eaedf75674f88b41cbdc0eac33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b0a56e9724ccd81df765dfc49739d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:54.343662 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-cfd9b718-00bf-4488-8b64-9de5bc131b28 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52" status: 200 len: 1756 microversion: 2.1 time: 0.192804 Aug 09 11:27:54.344231 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 537/1098] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:54 2022] GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52 => generated 1756 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:55.369898 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-e3e87b37-581c-4224-aac4-7c252c9237b8 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:55.370881 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-e3e87b37-581c-4224-aac4-7c252c9237b8 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] [instance: 9020822d-a8c7-4fe5-a322-0be8f8148d52] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:55.381647 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e3e87b37-581c-4224-aac4-7c252c9237b8 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:55.382441 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e3e87b37-581c-4224-aac4-7c252c9237b8 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:55.383153 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e3e87b37-581c-4224-aac4-7c252c9237b8 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:55.384322 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e3e87b37-581c-4224-aac4-7c252c9237b8 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:55.385079 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e3e87b37-581c-4224-aac4-7c252c9237b8 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:55.385773 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e3e87b37-581c-4224-aac4-7c252c9237b8 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:55.535749 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-e3e87b37-581c-4224-aac4-7c252c9237b8 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909eaedf75674f88b41cbdc0eac33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b0a56e9724ccd81df765dfc49739d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:55.544246 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-e3e87b37-581c-4224-aac4-7c252c9237b8 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52" status: 200 len: 1756 microversion: 2.1 time: 0.180853 Aug 09 11:27:55.544863 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 562/1099] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:55 2022] GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52 => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:56.570000 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-01e3591a-83d2-4f11-8ad3-9a98c9e6e59c tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:56.570965 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-01e3591a-83d2-4f11-8ad3-9a98c9e6e59c tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] [instance: 9020822d-a8c7-4fe5-a322-0be8f8148d52] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:56.580045 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-01e3591a-83d2-4f11-8ad3-9a98c9e6e59c tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:56.580551 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-01e3591a-83d2-4f11-8ad3-9a98c9e6e59c tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:56.580981 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-01e3591a-83d2-4f11-8ad3-9a98c9e6e59c tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:56.581664 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-01e3591a-83d2-4f11-8ad3-9a98c9e6e59c tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:56.582166 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-01e3591a-83d2-4f11-8ad3-9a98c9e6e59c tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:56.582584 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-01e3591a-83d2-4f11-8ad3-9a98c9e6e59c tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:56.737713 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-01e3591a-83d2-4f11-8ad3-9a98c9e6e59c tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909eaedf75674f88b41cbdc0eac33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b0a56e9724ccd81df765dfc49739d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:56.746272 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-01e3591a-83d2-4f11-8ad3-9a98c9e6e59c tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52" status: 200 len: 1756 microversion: 2.1 time: 0.182993 Aug 09 11:27:56.746841 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 538/1100] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:56 2022] GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52 => generated 1756 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:57.767569 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-a1e60360-84ae-485e-8565-b284019d8373 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:57.768256 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-a1e60360-84ae-485e-8565-b284019d8373 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] [instance: 9020822d-a8c7-4fe5-a322-0be8f8148d52] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:57.776014 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a1e60360-84ae-485e-8565-b284019d8373 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:57.776538 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a1e60360-84ae-485e-8565-b284019d8373 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:57.776963 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a1e60360-84ae-485e-8565-b284019d8373 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:57.777668 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a1e60360-84ae-485e-8565-b284019d8373 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:57.778110 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a1e60360-84ae-485e-8565-b284019d8373 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:57.778526 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-a1e60360-84ae-485e-8565-b284019d8373 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:57.935528 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-a1e60360-84ae-485e-8565-b284019d8373 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909eaedf75674f88b41cbdc0eac33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b0a56e9724ccd81df765dfc49739d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:57.943692 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-a1e60360-84ae-485e-8565-b284019d8373 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52" status: 200 len: 1756 microversion: 2.1 time: 0.180286 Aug 09 11:27:57.944260 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 563/1101] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:57 2022] GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52 => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:58.968181 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-cdfb777f-fd21-4c3f-898b-9e9da0e15ea1 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:58.968895 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-cdfb777f-fd21-4c3f-898b-9e9da0e15ea1 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] [instance: 9020822d-a8c7-4fe5-a322-0be8f8148d52] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:58.975852 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cdfb777f-fd21-4c3f-898b-9e9da0e15ea1 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:58.976369 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cdfb777f-fd21-4c3f-898b-9e9da0e15ea1 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:58.976790 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cdfb777f-fd21-4c3f-898b-9e9da0e15ea1 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:58.977472 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cdfb777f-fd21-4c3f-898b-9e9da0e15ea1 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:58.977933 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cdfb777f-fd21-4c3f-898b-9e9da0e15ea1 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:58.978342 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cdfb777f-fd21-4c3f-898b-9e9da0e15ea1 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:59.150701 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-cdfb777f-fd21-4c3f-898b-9e9da0e15ea1 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909eaedf75674f88b41cbdc0eac33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b0a56e9724ccd81df765dfc49739d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:59.160712 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-cdfb777f-fd21-4c3f-898b-9e9da0e15ea1 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52" status: 200 len: 1756 microversion: 2.1 time: 0.198002 Aug 09 11:27:59.161278 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 539/1102] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:58 2022] GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52 => generated 1756 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:00.190284 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-057b25ed-de0a-41d2-ba87-6d8959eee089 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:00.191629 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-057b25ed-de0a-41d2-ba87-6d8959eee089 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] [instance: 9020822d-a8c7-4fe5-a322-0be8f8148d52] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:00.202779 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-057b25ed-de0a-41d2-ba87-6d8959eee089 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:00.203290 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-057b25ed-de0a-41d2-ba87-6d8959eee089 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:00.203714 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-057b25ed-de0a-41d2-ba87-6d8959eee089 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:00.204560 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-057b25ed-de0a-41d2-ba87-6d8959eee089 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:00.205009 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-057b25ed-de0a-41d2-ba87-6d8959eee089 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:00.205508 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-057b25ed-de0a-41d2-ba87-6d8959eee089 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:00.368676 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-057b25ed-de0a-41d2-ba87-6d8959eee089 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909eaedf75674f88b41cbdc0eac33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b0a56e9724ccd81df765dfc49739d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:00.378785 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-057b25ed-de0a-41d2-ba87-6d8959eee089 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52" status: 200 len: 1756 microversion: 2.1 time: 0.196026 Aug 09 11:28:00.379347 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 564/1103] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:00 2022] GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52 => generated 1756 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:01.404988 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-2b2bf7eb-a84d-4a19-853f-37100dc73b84 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:01.405975 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-2b2bf7eb-a84d-4a19-853f-37100dc73b84 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] [instance: 9020822d-a8c7-4fe5-a322-0be8f8148d52] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:01.413082 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2b2bf7eb-a84d-4a19-853f-37100dc73b84 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:01.413567 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2b2bf7eb-a84d-4a19-853f-37100dc73b84 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:01.414002 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2b2bf7eb-a84d-4a19-853f-37100dc73b84 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:01.414699 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2b2bf7eb-a84d-4a19-853f-37100dc73b84 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:01.415149 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2b2bf7eb-a84d-4a19-853f-37100dc73b84 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:01.415576 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2b2bf7eb-a84d-4a19-853f-37100dc73b84 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:01.568584 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-2b2bf7eb-a84d-4a19-853f-37100dc73b84 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909eaedf75674f88b41cbdc0eac33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b0a56e9724ccd81df765dfc49739d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:01.576722 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-2b2bf7eb-a84d-4a19-853f-37100dc73b84 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52" status: 200 len: 1756 microversion: 2.1 time: 0.178842 Aug 09 11:28:01.577490 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 540/1104] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:01 2022] GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52 => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:02.602131 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-949da722-73e5-44ec-97ca-7c18fc55ceb3 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:02.603005 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-949da722-73e5-44ec-97ca-7c18fc55ceb3 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] [instance: 9020822d-a8c7-4fe5-a322-0be8f8148d52] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:02.614048 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-949da722-73e5-44ec-97ca-7c18fc55ceb3 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:02.614890 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-949da722-73e5-44ec-97ca-7c18fc55ceb3 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:02.615597 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-949da722-73e5-44ec-97ca-7c18fc55ceb3 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:02.616767 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-949da722-73e5-44ec-97ca-7c18fc55ceb3 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:02.617501 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-949da722-73e5-44ec-97ca-7c18fc55ceb3 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:02.618191 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-949da722-73e5-44ec-97ca-7c18fc55ceb3 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:03.042152 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-949da722-73e5-44ec-97ca-7c18fc55ceb3 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909eaedf75674f88b41cbdc0eac33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b0a56e9724ccd81df765dfc49739d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:03.050281 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-949da722-73e5-44ec-97ca-7c18fc55ceb3 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52" status: 200 len: 1756 microversion: 2.1 time: 0.454900 Aug 09 11:28:03.050854 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 565/1105] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:02 2022] GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52 => generated 1756 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:04.073691 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-2389d1d0-d6b3-4ec1-9311-637c77e93e9e tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:04.074299 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-2389d1d0-d6b3-4ec1-9311-637c77e93e9e tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] [instance: 9020822d-a8c7-4fe5-a322-0be8f8148d52] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:04.081279 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2389d1d0-d6b3-4ec1-9311-637c77e93e9e tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:04.081757 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2389d1d0-d6b3-4ec1-9311-637c77e93e9e tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:04.082180 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2389d1d0-d6b3-4ec1-9311-637c77e93e9e tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:04.082864 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2389d1d0-d6b3-4ec1-9311-637c77e93e9e tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:04.083306 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2389d1d0-d6b3-4ec1-9311-637c77e93e9e tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:04.083719 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2389d1d0-d6b3-4ec1-9311-637c77e93e9e tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:04.231937 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-2389d1d0-d6b3-4ec1-9311-637c77e93e9e tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909eaedf75674f88b41cbdc0eac33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b0a56e9724ccd81df765dfc49739d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:04.240245 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-2389d1d0-d6b3-4ec1-9311-637c77e93e9e tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52" status: 200 len: 1756 microversion: 2.1 time: 0.170506 Aug 09 11:28:04.240864 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 541/1106] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:04 2022] GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:05.265836 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-cecc9807-bbf3-4fc9-9333-f6a8c9139e48 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:05.266427 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-cecc9807-bbf3-4fc9-9333-f6a8c9139e48 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] [instance: 9020822d-a8c7-4fe5-a322-0be8f8148d52] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:05.273346 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-cecc9807-bbf3-4fc9-9333-f6a8c9139e48 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:05.273823 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-cecc9807-bbf3-4fc9-9333-f6a8c9139e48 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:05.274247 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-cecc9807-bbf3-4fc9-9333-f6a8c9139e48 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:05.275259 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-cecc9807-bbf3-4fc9-9333-f6a8c9139e48 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:05.275701 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-cecc9807-bbf3-4fc9-9333-f6a8c9139e48 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:05.276179 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-cecc9807-bbf3-4fc9-9333-f6a8c9139e48 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:05.430144 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-cecc9807-bbf3-4fc9-9333-f6a8c9139e48 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909eaedf75674f88b41cbdc0eac33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b0a56e9724ccd81df765dfc49739d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:05.438402 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-cecc9807-bbf3-4fc9-9333-f6a8c9139e48 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52" status: 200 len: 1756 microversion: 2.1 time: 0.178884 Aug 09 11:28:05.439087 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 566/1107] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:05 2022] GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52 => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:06.463707 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-32eba192-1649-4212-af6e-030552495a26 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:06.464787 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-32eba192-1649-4212-af6e-030552495a26 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] [instance: 9020822d-a8c7-4fe5-a322-0be8f8148d52] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:06.473170 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-32eba192-1649-4212-af6e-030552495a26 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:06.473657 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-32eba192-1649-4212-af6e-030552495a26 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:06.474094 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-32eba192-1649-4212-af6e-030552495a26 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:06.474791 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-32eba192-1649-4212-af6e-030552495a26 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:06.475248 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-32eba192-1649-4212-af6e-030552495a26 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:06.475672 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-32eba192-1649-4212-af6e-030552495a26 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:06.619345 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-32eba192-1649-4212-af6e-030552495a26 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909eaedf75674f88b41cbdc0eac33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b0a56e9724ccd81df765dfc49739d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:06.629800 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-32eba192-1649-4212-af6e-030552495a26 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52" status: 200 len: 1756 microversion: 2.1 time: 0.172742 Aug 09 11:28:06.630373 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 542/1108] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:06 2022] GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:07.655592 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-6eedde3c-c78d-4335-8fb6-756585253451 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:07.656948 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-6eedde3c-c78d-4335-8fb6-756585253451 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] [instance: 9020822d-a8c7-4fe5-a322-0be8f8148d52] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:07.667636 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6eedde3c-c78d-4335-8fb6-756585253451 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:07.668531 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6eedde3c-c78d-4335-8fb6-756585253451 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:07.669249 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6eedde3c-c78d-4335-8fb6-756585253451 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:07.670473 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6eedde3c-c78d-4335-8fb6-756585253451 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:07.671182 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6eedde3c-c78d-4335-8fb6-756585253451 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:07.671831 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6eedde3c-c78d-4335-8fb6-756585253451 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:07.822198 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-6eedde3c-c78d-4335-8fb6-756585253451 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909eaedf75674f88b41cbdc0eac33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b0a56e9724ccd81df765dfc49739d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:07.830619 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-6eedde3c-c78d-4335-8fb6-756585253451 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52" status: 200 len: 1756 microversion: 2.1 time: 0.181843 Aug 09 11:28:07.831194 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 567/1109] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:07 2022] GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52 => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:08.852925 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-8958c9d5-65e9-4ed1-ad61-55b2ac6796a5 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:08.853579 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-8958c9d5-65e9-4ed1-ad61-55b2ac6796a5 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] [instance: 9020822d-a8c7-4fe5-a322-0be8f8148d52] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:08.861378 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8958c9d5-65e9-4ed1-ad61-55b2ac6796a5 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:08.861948 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8958c9d5-65e9-4ed1-ad61-55b2ac6796a5 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:08.862478 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8958c9d5-65e9-4ed1-ad61-55b2ac6796a5 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:08.863237 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8958c9d5-65e9-4ed1-ad61-55b2ac6796a5 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:08.863755 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8958c9d5-65e9-4ed1-ad61-55b2ac6796a5 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:08.864238 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-8958c9d5-65e9-4ed1-ad61-55b2ac6796a5 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:09.014490 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-8958c9d5-65e9-4ed1-ad61-55b2ac6796a5 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909eaedf75674f88b41cbdc0eac33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b0a56e9724ccd81df765dfc49739d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:09.023017 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-8958c9d5-65e9-4ed1-ad61-55b2ac6796a5 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52" status: 200 len: 1759 microversion: 2.1 time: 0.174512 Aug 09 11:28:09.023581 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 543/1110] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:08 2022] GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52 => generated 1759 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:16.628633 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-aedcbe18-a57b-4506-a2b9-622e3794627c tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-416796516", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1024053701", "security_groups": [{"name": "tempest-secgroup-smoke-1801499321"}], "block_device_mapping_v2": [{"uuid": "e5102212-2a0f-4ff5-b6ab-d47ce990fac3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "940543e4-99c0-4b6e-ad06-93fe4eaedd74"}]}} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:28:16.749880 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.network.neutron [None req-aedcbe18-a57b-4506-a2b9-622e3794627c tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] validate_networks() for [('940543e4-99c0-4b6e-ad06-93fe4eaedd74', None, None, None, None, None)] {{(pid=117685) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 11:28:17.157476 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-aedcbe18-a57b-4506-a2b9-622e3794627c tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Flavor limits 0:0:0 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 11:28:17.158054 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-aedcbe18-a57b-4506-a2b9-622e3794627c tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Image limits 0:0:0 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 11:28:17.158740 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-aedcbe18-a57b-4506-a2b9-622e3794627c tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Flavor pref 0:0:0 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 11:28:17.159305 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-aedcbe18-a57b-4506-a2b9-622e3794627c tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Image pref 0:0:0 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 11:28:17.159884 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.virt.hardware [None req-aedcbe18-a57b-4506-a2b9-622e3794627c tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 11:28:17.173126 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-aedcbe18-a57b-4506-a2b9-622e3794627c tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:17.173774 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-aedcbe18-a57b-4506-a2b9-622e3794627c tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:17.174392 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-aedcbe18-a57b-4506-a2b9-622e3794627c tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:17.175318 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-aedcbe18-a57b-4506-a2b9-622e3794627c tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:17.176011 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-aedcbe18-a57b-4506-a2b9-622e3794627c tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:17.176463 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-aedcbe18-a57b-4506-a2b9-622e3794627c tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:17.193138 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.quota [None req-aedcbe18-a57b-4506-a2b9-622e3794627c tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Getting quotas for project bfd671fcff7e4b24b5415a3a1b70ad0f. Resources: {'cores', 'instances', 'ram'} {{(pid=117685) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:28:17.197324 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.quota [None req-aedcbe18-a57b-4506-a2b9-622e3794627c tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Getting quotas for user 5b4c4030b5fb4381a598a54588880b75 and project bfd671fcff7e4b24b5415a3a1b70ad0f. Resources: {'cores', 'instances', 'ram'} {{(pid=117685) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:28:17.257536 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-aedcbe18-a57b-4506-a2b9-622e3794627c tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Going to run 1 instances... {{(pid=117685) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 11:28:17.260916 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-aedcbe18-a57b-4506-a2b9-622e3794627c tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 5ccbdf55-3c9d-49f6-b3fd-50e822069991] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e5102212-2a0f-4ff5-b6ab-d47ce990fac3',volume_size=None,volume_type=None)] {{(pid=117685) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 11:28:17.401175 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-aedcbe18-a57b-4506-a2b9-622e3794627c tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.778886 Aug 09 11:28:17.401987 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 568/1111] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 9 11:28:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 11:28:17.412765 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-a5b2956e-9289-4de7-bb96-a3c5f32bca7e tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:17.413327 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-a5b2956e-9289-4de7-bb96-a3c5f32bca7e tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 5ccbdf55-3c9d-49f6-b3fd-50e822069991] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:17.470639 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-a5b2956e-9289-4de7-bb96-a3c5f32bca7e tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:17.487774 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-a5b2956e-9289-4de7-bb96-a3c5f32bca7e tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/5ccbdf55-3c9d-49f6-b3fd-50e822069991" status: 200 len: 1094 microversion: 2.1 time: 0.078993 Aug 09 11:28:17.488309 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 544/1112] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:17 2022] GET /compute/v2.1/servers/5ccbdf55-3c9d-49f6-b3fd-50e822069991 => generated 1094 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:18.509243 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-c3a3abea-5a7e-44f3-93be-d3846ac9805e tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:18.510501 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-c3a3abea-5a7e-44f3-93be-d3846ac9805e tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 5ccbdf55-3c9d-49f6-b3fd-50e822069991] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:18.518739 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c3a3abea-5a7e-44f3-93be-d3846ac9805e tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:18.519481 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c3a3abea-5a7e-44f3-93be-d3846ac9805e tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:18.520049 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c3a3abea-5a7e-44f3-93be-d3846ac9805e tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:18.521378 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c3a3abea-5a7e-44f3-93be-d3846ac9805e tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:18.522172 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c3a3abea-5a7e-44f3-93be-d3846ac9805e tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:18.522814 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c3a3abea-5a7e-44f3-93be-d3846ac9805e tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:18.587172 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-c3a3abea-5a7e-44f3-93be-d3846ac9805e tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:18.595386 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-c3a3abea-5a7e-44f3-93be-d3846ac9805e tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/5ccbdf55-3c9d-49f6-b3fd-50e822069991" status: 200 len: 1210 microversion: 2.1 time: 0.091018 Aug 09 11:28:18.596297 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 569/1113] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:18 2022] GET /compute/v2.1/servers/5ccbdf55-3c9d-49f6-b3fd-50e822069991 => generated 1210 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:19.616845 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-ea3f23da-c2f5-435b-aac0-bbb862bcfbcc tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:19.617486 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-ea3f23da-c2f5-435b-aac0-bbb862bcfbcc tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 5ccbdf55-3c9d-49f6-b3fd-50e822069991] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:19.620214 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell1:SELECT=48 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:19.626379 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ea3f23da-c2f5-435b-aac0-bbb862bcfbcc tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:19.626858 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ea3f23da-c2f5-435b-aac0-bbb862bcfbcc tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:19.627286 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ea3f23da-c2f5-435b-aac0-bbb862bcfbcc tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:19.628043 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ea3f23da-c2f5-435b-aac0-bbb862bcfbcc tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:19.628513 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ea3f23da-c2f5-435b-aac0-bbb862bcfbcc tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:19.628925 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-ea3f23da-c2f5-435b-aac0-bbb862bcfbcc tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:19.767823 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-ea3f23da-c2f5-435b-aac0-bbb862bcfbcc tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:19.776696 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-ea3f23da-c2f5-435b-aac0-bbb862bcfbcc tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/5ccbdf55-3c9d-49f6-b3fd-50e822069991" status: 200 len: 1266 microversion: 2.1 time: 0.163904 Aug 09 11:28:19.777293 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 545/1114] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:19 2022] GET /compute/v2.1/servers/5ccbdf55-3c9d-49f6-b3fd-50e822069991 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:20.139628 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-75df8495-b516-4b52-8100-30771dfe4c02 req-9048dd23-9d47-43e2-b81f-89c975b33093 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ccbdf55-3c9d-49f6-b3fd-50e822069991", "tag": "7b96ad0e-09d6-4e0a-ae5a-f88b0bcce574"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:28:20.150469 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-75df8495-b516-4b52-8100-30771dfe4c02 req-9048dd23-9d47-43e2-b81f-89c975b33093 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:20.151043 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-75df8495-b516-4b52-8100-30771dfe4c02 req-9048dd23-9d47-43e2-b81f-89c975b33093 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:20.151472 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-75df8495-b516-4b52-8100-30771dfe4c02 req-9048dd23-9d47-43e2-b81f-89c975b33093 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:20.162926 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-75df8495-b516-4b52-8100-30771dfe4c02 req-9048dd23-9d47-43e2-b81f-89c975b33093 service nova] Creating event network-changed:7b96ad0e-09d6-4e0a-ae5a-f88b0bcce574 for instance 5ccbdf55-3c9d-49f6-b3fd-50e822069991 on hv-cinder-85251 Aug 09 11:28:20.167804 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-75df8495-b516-4b52-8100-30771dfe4c02 req-9048dd23-9d47-43e2-b81f-89c975b33093 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032191 Aug 09 11:28:20.168720 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 570/1115] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:28:20.802813 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-42785cbf-38b1-4cdb-9eec-48a3bf794d34 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:20.803992 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-42785cbf-38b1-4cdb-9eec-48a3bf794d34 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 5ccbdf55-3c9d-49f6-b3fd-50e822069991] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:20.812086 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-42785cbf-38b1-4cdb-9eec-48a3bf794d34 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:20.812832 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-42785cbf-38b1-4cdb-9eec-48a3bf794d34 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:20.813336 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-42785cbf-38b1-4cdb-9eec-48a3bf794d34 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:20.814042 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-42785cbf-38b1-4cdb-9eec-48a3bf794d34 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:20.814491 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-42785cbf-38b1-4cdb-9eec-48a3bf794d34 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:20.814930 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-42785cbf-38b1-4cdb-9eec-48a3bf794d34 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:20.959715 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-42785cbf-38b1-4cdb-9eec-48a3bf794d34 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:20.970760 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-42785cbf-38b1-4cdb-9eec-48a3bf794d34 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/5ccbdf55-3c9d-49f6-b3fd-50e822069991" status: 200 len: 1266 microversion: 2.1 time: 0.174781 Aug 09 11:28:20.971890 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 546/1116] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:20 2022] GET /compute/v2.1/servers/5ccbdf55-3c9d-49f6-b3fd-50e822069991 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:22.010147 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-72cf731e-04e8-4fcc-b46a-af775ceb21c7 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:22.010975 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-72cf731e-04e8-4fcc-b46a-af775ceb21c7 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 5ccbdf55-3c9d-49f6-b3fd-50e822069991] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:22.013535 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:22.021503 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-72cf731e-04e8-4fcc-b46a-af775ceb21c7 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:22.022865 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-72cf731e-04e8-4fcc-b46a-af775ceb21c7 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:22.023494 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-72cf731e-04e8-4fcc-b46a-af775ceb21c7 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:22.025014 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-72cf731e-04e8-4fcc-b46a-af775ceb21c7 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:22.025609 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-72cf731e-04e8-4fcc-b46a-af775ceb21c7 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:22.026218 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-72cf731e-04e8-4fcc-b46a-af775ceb21c7 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:22.031035 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:22.169901 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-72cf731e-04e8-4fcc-b46a-af775ceb21c7 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:22.182575 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-72cf731e-04e8-4fcc-b46a-af775ceb21c7 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/5ccbdf55-3c9d-49f6-b3fd-50e822069991" status: 200 len: 1266 microversion: 2.1 time: 0.186521 Aug 09 11:28:22.183382 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 571/1117] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:21 2022] GET /compute/v2.1/servers/5ccbdf55-3c9d-49f6-b3fd-50e822069991 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:23.203295 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-1a5df285-1e10-4d74-8011-80f332014ffa tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:23.203913 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-1a5df285-1e10-4d74-8011-80f332014ffa tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 5ccbdf55-3c9d-49f6-b3fd-50e822069991] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:23.206346 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_api:SELECT=25 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:23.212154 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1a5df285-1e10-4d74-8011-80f332014ffa tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:23.212673 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1a5df285-1e10-4d74-8011-80f332014ffa tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:23.213128 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1a5df285-1e10-4d74-8011-80f332014ffa tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:23.213817 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1a5df285-1e10-4d74-8011-80f332014ffa tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:23.214263 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1a5df285-1e10-4d74-8011-80f332014ffa tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:23.214691 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1a5df285-1e10-4d74-8011-80f332014ffa tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:23.360392 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-1a5df285-1e10-4d74-8011-80f332014ffa tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:23.370223 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-1a5df285-1e10-4d74-8011-80f332014ffa tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/5ccbdf55-3c9d-49f6-b3fd-50e822069991" status: 200 len: 1266 microversion: 2.1 time: 0.170919 Aug 09 11:28:23.370794 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 547/1118] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:23 2022] GET /compute/v2.1/servers/5ccbdf55-3c9d-49f6-b3fd-50e822069991 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:24.395416 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-e2c5e55c-3024-41c9-b689-ed8f476aa57b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:24.396373 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-e2c5e55c-3024-41c9-b689-ed8f476aa57b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 5ccbdf55-3c9d-49f6-b3fd-50e822069991] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:24.407657 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e2c5e55c-3024-41c9-b689-ed8f476aa57b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:24.408503 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e2c5e55c-3024-41c9-b689-ed8f476aa57b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:24.409211 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e2c5e55c-3024-41c9-b689-ed8f476aa57b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:24.410335 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e2c5e55c-3024-41c9-b689-ed8f476aa57b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:24.411107 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e2c5e55c-3024-41c9-b689-ed8f476aa57b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:24.411752 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-e2c5e55c-3024-41c9-b689-ed8f476aa57b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:24.551313 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-e2c5e55c-3024-41c9-b689-ed8f476aa57b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:24.560574 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-e2c5e55c-3024-41c9-b689-ed8f476aa57b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/5ccbdf55-3c9d-49f6-b3fd-50e822069991" status: 200 len: 1266 microversion: 2.1 time: 0.171666 Aug 09 11:28:24.561133 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 572/1119] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:24 2022] GET /compute/v2.1/servers/5ccbdf55-3c9d-49f6-b3fd-50e822069991 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:25.585742 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-80cc57db-c56d-43fb-a208-42d32ef83f0b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:25.586377 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-80cc57db-c56d-43fb-a208-42d32ef83f0b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 5ccbdf55-3c9d-49f6-b3fd-50e822069991] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:25.593226 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-80cc57db-c56d-43fb-a208-42d32ef83f0b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:25.593711 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-80cc57db-c56d-43fb-a208-42d32ef83f0b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:25.594143 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-80cc57db-c56d-43fb-a208-42d32ef83f0b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:25.594837 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-80cc57db-c56d-43fb-a208-42d32ef83f0b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:25.595280 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-80cc57db-c56d-43fb-a208-42d32ef83f0b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:25.595704 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-80cc57db-c56d-43fb-a208-42d32ef83f0b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:25.736763 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-80cc57db-c56d-43fb-a208-42d32ef83f0b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:25.744896 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-80cc57db-c56d-43fb-a208-42d32ef83f0b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/5ccbdf55-3c9d-49f6-b3fd-50e822069991" status: 200 len: 1266 microversion: 2.1 time: 0.166210 Aug 09 11:28:25.745460 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 548/1120] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:25 2022] GET /compute/v2.1/servers/5ccbdf55-3c9d-49f6-b3fd-50e822069991 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:26.769930 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-617605a2-e844-4b70-8d9b-3509ef074614 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:26.770934 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-617605a2-e844-4b70-8d9b-3509ef074614 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 5ccbdf55-3c9d-49f6-b3fd-50e822069991] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:26.779280 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-617605a2-e844-4b70-8d9b-3509ef074614 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:26.779758 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-617605a2-e844-4b70-8d9b-3509ef074614 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:26.780185 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-617605a2-e844-4b70-8d9b-3509ef074614 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:26.780904 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-617605a2-e844-4b70-8d9b-3509ef074614 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:26.781350 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-617605a2-e844-4b70-8d9b-3509ef074614 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:26.781756 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-617605a2-e844-4b70-8d9b-3509ef074614 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:26.919317 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-617605a2-e844-4b70-8d9b-3509ef074614 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:26.927305 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-617605a2-e844-4b70-8d9b-3509ef074614 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/5ccbdf55-3c9d-49f6-b3fd-50e822069991" status: 200 len: 1266 microversion: 2.1 time: 0.163770 Aug 09 11:28:26.927853 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 573/1121] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:26 2022] GET /compute/v2.1/servers/5ccbdf55-3c9d-49f6-b3fd-50e822069991 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:27.949090 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-7ab33da6-0a99-4265-ad57-5d8e16b751e9 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:27.949706 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-7ab33da6-0a99-4265-ad57-5d8e16b751e9 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 5ccbdf55-3c9d-49f6-b3fd-50e822069991] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:27.952125 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell0:SELECT=2 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:27.957147 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7ab33da6-0a99-4265-ad57-5d8e16b751e9 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:27.957655 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7ab33da6-0a99-4265-ad57-5d8e16b751e9 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:27.958074 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7ab33da6-0a99-4265-ad57-5d8e16b751e9 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:27.958774 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7ab33da6-0a99-4265-ad57-5d8e16b751e9 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:27.959224 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7ab33da6-0a99-4265-ad57-5d8e16b751e9 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:27.959645 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-7ab33da6-0a99-4265-ad57-5d8e16b751e9 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:28.099217 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-7ab33da6-0a99-4265-ad57-5d8e16b751e9 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:28.108091 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-7ab33da6-0a99-4265-ad57-5d8e16b751e9 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/5ccbdf55-3c9d-49f6-b3fd-50e822069991" status: 200 len: 1266 microversion: 2.1 time: 0.163166 Aug 09 11:28:28.108692 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 549/1122] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:27 2022] GET /compute/v2.1/servers/5ccbdf55-3c9d-49f6-b3fd-50e822069991 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:29.132869 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-7666d3d1-1724-49f3-9d30-b72bfc6b0527 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:29.133820 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-7666d3d1-1724-49f3-9d30-b72bfc6b0527 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 5ccbdf55-3c9d-49f6-b3fd-50e822069991] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:29.137026 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell0:SELECT=2 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:29.138095 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell0:SELECT=6 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:29.150736 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7666d3d1-1724-49f3-9d30-b72bfc6b0527 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:29.151237 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7666d3d1-1724-49f3-9d30-b72bfc6b0527 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:29.151675 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7666d3d1-1724-49f3-9d30-b72bfc6b0527 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:29.152393 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7666d3d1-1724-49f3-9d30-b72bfc6b0527 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:29.152828 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7666d3d1-1724-49f3-9d30-b72bfc6b0527 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:29.153248 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-7666d3d1-1724-49f3-9d30-b72bfc6b0527 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:29.299896 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-7666d3d1-1724-49f3-9d30-b72bfc6b0527 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:29.307736 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-7666d3d1-1724-49f3-9d30-b72bfc6b0527 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/5ccbdf55-3c9d-49f6-b3fd-50e822069991" status: 200 len: 1266 microversion: 2.1 time: 0.181358 Aug 09 11:28:29.308334 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 574/1123] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:29 2022] GET /compute/v2.1/servers/5ccbdf55-3c9d-49f6-b3fd-50e822069991 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:29.879674 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [req-eebd1c8b-ae7a-4a86-8e53-da24c4fae54f req-673c3fae-83cc-499b-b483-6d0ee3ecbd45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ccbdf55-3c9d-49f6-b3fd-50e822069991", "name": "network-vif-plugged", "status": "completed", "tag": "7b96ad0e-09d6-4e0a-ae5a-f88b0bcce574"}]} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:28:29.890072 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-eebd1c8b-ae7a-4a86-8e53-da24c4fae54f req-673c3fae-83cc-499b-b483-6d0ee3ecbd45 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:29.890551 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-eebd1c8b-ae7a-4a86-8e53-da24c4fae54f req-673c3fae-83cc-499b-b483-6d0ee3ecbd45 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:29.891021 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-eebd1c8b-ae7a-4a86-8e53-da24c4fae54f req-673c3fae-83cc-499b-b483-6d0ee3ecbd45 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:29.903212 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.compute.server_external_events [req-eebd1c8b-ae7a-4a86-8e53-da24c4fae54f req-673c3fae-83cc-499b-b483-6d0ee3ecbd45 service nova] Creating event network-vif-plugged:7b96ad0e-09d6-4e0a-ae5a-f88b0bcce574 for instance 5ccbdf55-3c9d-49f6-b3fd-50e822069991 on hv-cinder-85251 Aug 09 11:28:29.908291 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [req-eebd1c8b-ae7a-4a86-8e53-da24c4fae54f req-673c3fae-83cc-499b-b483-6d0ee3ecbd45 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092917 Aug 09 11:28:29.908924 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 550/1124] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:28:30.332571 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-c6f76b03-add2-4d86-aa1f-b8eae95cc6af tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:30.333528 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-c6f76b03-add2-4d86-aa1f-b8eae95cc6af tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 5ccbdf55-3c9d-49f6-b3fd-50e822069991] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:30.344667 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c6f76b03-add2-4d86-aa1f-b8eae95cc6af tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:30.345463 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c6f76b03-add2-4d86-aa1f-b8eae95cc6af tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:30.346165 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c6f76b03-add2-4d86-aa1f-b8eae95cc6af tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:30.347284 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c6f76b03-add2-4d86-aa1f-b8eae95cc6af tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:30.348023 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c6f76b03-add2-4d86-aa1f-b8eae95cc6af tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:30.348804 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c6f76b03-add2-4d86-aa1f-b8eae95cc6af tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:30.493588 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-c6f76b03-add2-4d86-aa1f-b8eae95cc6af tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:30.501327 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-c6f76b03-add2-4d86-aa1f-b8eae95cc6af tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/5ccbdf55-3c9d-49f6-b3fd-50e822069991" status: 200 len: 1266 microversion: 2.1 time: 0.175236 Aug 09 11:28:30.501897 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 575/1125] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:30 2022] GET /compute/v2.1/servers/5ccbdf55-3c9d-49f6-b3fd-50e822069991 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:31.528658 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-1a6e200b-e9ef-4ab7-8856-2cd7c3bea1ca tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:31.529345 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-1a6e200b-e9ef-4ab7-8856-2cd7c3bea1ca tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 5ccbdf55-3c9d-49f6-b3fd-50e822069991] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:31.536171 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1a6e200b-e9ef-4ab7-8856-2cd7c3bea1ca tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:31.536681 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1a6e200b-e9ef-4ab7-8856-2cd7c3bea1ca tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:31.537115 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1a6e200b-e9ef-4ab7-8856-2cd7c3bea1ca tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:31.537816 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1a6e200b-e9ef-4ab7-8856-2cd7c3bea1ca tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:31.538258 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1a6e200b-e9ef-4ab7-8856-2cd7c3bea1ca tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:31.538686 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-1a6e200b-e9ef-4ab7-8856-2cd7c3bea1ca tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:31.686140 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-1a6e200b-e9ef-4ab7-8856-2cd7c3bea1ca tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:31.693978 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-1a6e200b-e9ef-4ab7-8856-2cd7c3bea1ca tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/5ccbdf55-3c9d-49f6-b3fd-50e822069991" status: 200 len: 1453 microversion: 2.1 time: 0.174052 Aug 09 11:28:31.694553 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 551/1126] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:31 2022] GET /compute/v2.1/servers/5ccbdf55-3c9d-49f6-b3fd-50e822069991 => generated 1453 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:31.715911 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-af2a863a-04eb-4146-a928-52edd30d4485 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:31.716673 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-af2a863a-04eb-4146-a928-52edd30d4485 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 5ccbdf55-3c9d-49f6-b3fd-50e822069991] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:31.723257 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-af2a863a-04eb-4146-a928-52edd30d4485 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:31.723735 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-af2a863a-04eb-4146-a928-52edd30d4485 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:31.724158 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-af2a863a-04eb-4146-a928-52edd30d4485 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:31.724879 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-af2a863a-04eb-4146-a928-52edd30d4485 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:31.725321 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-af2a863a-04eb-4146-a928-52edd30d4485 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:31.725735 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-af2a863a-04eb-4146-a928-52edd30d4485 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:31.867090 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-af2a863a-04eb-4146-a928-52edd30d4485 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:31.876854 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-af2a863a-04eb-4146-a928-52edd30d4485 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/5ccbdf55-3c9d-49f6-b3fd-50e822069991" status: 200 len: 1453 microversion: 2.1 time: 0.165413 Aug 09 11:28:31.877430 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 576/1127] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:31 2022] GET /compute/v2.1/servers/5ccbdf55-3c9d-49f6-b3fd-50e822069991 => generated 1453 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:33.610554 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [req-7cee0e70-33ba-470d-9cdc-cd5d5331ce0c req-17ec0ccf-eb23-4c47-b703-3aa9a2906225 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ccbdf55-3c9d-49f6-b3fd-50e822069991", "tag": "7b96ad0e-09d6-4e0a-ae5a-f88b0bcce574"}]} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:28:33.620033 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-7cee0e70-33ba-470d-9cdc-cd5d5331ce0c req-17ec0ccf-eb23-4c47-b703-3aa9a2906225 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:33.620544 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-7cee0e70-33ba-470d-9cdc-cd5d5331ce0c req-17ec0ccf-eb23-4c47-b703-3aa9a2906225 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:33.620998 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-7cee0e70-33ba-470d-9cdc-cd5d5331ce0c req-17ec0ccf-eb23-4c47-b703-3aa9a2906225 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:33.633544 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.compute.server_external_events [req-7cee0e70-33ba-470d-9cdc-cd5d5331ce0c req-17ec0ccf-eb23-4c47-b703-3aa9a2906225 service nova] Creating event network-changed:7b96ad0e-09d6-4e0a-ae5a-f88b0bcce574 for instance 5ccbdf55-3c9d-49f6-b3fd-50e822069991 on hv-cinder-85251 Aug 09 11:28:33.638957 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [req-7cee0e70-33ba-470d-9cdc-cd5d5331ce0c req-17ec0ccf-eb23-4c47-b703-3aa9a2906225 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091688 Aug 09 11:28:33.639748 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 552/1128] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:28:41.755909 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-3eb2ffcc-20a4-412b-9e03-5ba4e53cdd85 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1324635282"}} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:28:41.756612 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-3eb2ffcc-20a4-412b-9e03-5ba4e53cdd85 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] [instance: 9020822d-a8c7-4fe5-a322-0be8f8148d52] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:41.759258 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_api:SELECT=11 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:41.766843 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3eb2ffcc-20a4-412b-9e03-5ba4e53cdd85 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:41.767329 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3eb2ffcc-20a4-412b-9e03-5ba4e53cdd85 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:41.767754 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3eb2ffcc-20a4-412b-9e03-5ba4e53cdd85 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:41.768492 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3eb2ffcc-20a4-412b-9e03-5ba4e53cdd85 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:41.768943 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3eb2ffcc-20a4-412b-9e03-5ba4e53cdd85 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:41.769372 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-3eb2ffcc-20a4-412b-9e03-5ba4e53cdd85 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:41.907142 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.network.security_group_api [None req-3eb2ffcc-20a4-412b-9e03-5ba4e53cdd85 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Removing security group 9b869fe3-5f4f-4792-9f05-bd97847ad6fa from port 2dac4157-7a6b-4a3a-9472-72b1cce67e96 Aug 09 11:28:42.242941 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-3eb2ffcc-20a4-412b-9e03-5ba4e53cdd85 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "POST /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52/action" status: 202 len: 0 microversion: 2.1 time: 0.492828 Aug 09 11:28:42.244053 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 577/1129] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 9 11:28:41 2022] POST /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52/action => generated 0 bytes in 495 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:28:42.256049 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [req-89d6a078-5964-471f-a40c-7b47ac607b86 req-9d96817c-d1f2-4e4a-a182-08efb9105740 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9020822d-a8c7-4fe5-a322-0be8f8148d52", "tag": "2dac4157-7a6b-4a3a-9472-72b1cce67e96"}]} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:28:42.275330 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-89d6a078-5964-471f-a40c-7b47ac607b86 req-9d96817c-d1f2-4e4a-a182-08efb9105740 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:42.276677 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-89d6a078-5964-471f-a40c-7b47ac607b86 req-9d96817c-d1f2-4e4a-a182-08efb9105740 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:42.277818 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-89d6a078-5964-471f-a40c-7b47ac607b86 req-9d96817c-d1f2-4e4a-a182-08efb9105740 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:42.297439 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.compute.server_external_events [req-89d6a078-5964-471f-a40c-7b47ac607b86 req-9d96817c-d1f2-4e4a-a182-08efb9105740 service nova] Creating event network-changed:2dac4157-7a6b-4a3a-9472-72b1cce67e96 for instance 9020822d-a8c7-4fe5-a322-0be8f8148d52 on hv-cinder-85251 Aug 09 11:28:42.303838 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [req-89d6a078-5964-471f-a40c-7b47ac607b86 req-9d96817c-d1f2-4e4a-a182-08efb9105740 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055352 Aug 09 11:28:42.304938 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 553/1130] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:28:43.794709 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-98bba196-c821-4898-b9d0-310607388d7b tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:43.795408 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-98bba196-c821-4898-b9d0-310607388d7b tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] [instance: 9020822d-a8c7-4fe5-a322-0be8f8148d52] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:43.801704 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-98bba196-c821-4898-b9d0-310607388d7b tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:43.802177 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-98bba196-c821-4898-b9d0-310607388d7b tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:43.802608 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-98bba196-c821-4898-b9d0-310607388d7b tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:43.803292 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-98bba196-c821-4898-b9d0-310607388d7b tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:43.803733 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-98bba196-c821-4898-b9d0-310607388d7b tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:43.804153 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-98bba196-c821-4898-b9d0-310607388d7b tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:43.887826 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.objects.instance [None req-98bba196-c821-4898-b9d0-310607388d7b tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lazy-loading 'services' on Instance uuid 9020822d-a8c7-4fe5-a322-0be8f8148d52 {{(pid=117685) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:28:43.968213 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-98bba196-c821-4898-b9d0-310607388d7b tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52/os-volume_attachments/cc7f5501-8780-4eef-bdf1-6377f2024b06" status: 202 len: 0 microversion: 2.1 time: 0.177826 Aug 09 11:28:43.969096 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 578/1131] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Aug 9 11:28:43 2022] DELETE /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52/os-volume_attachments/cc7f5501-8780-4eef-bdf1-6377f2024b06 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:28:43.978830 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-4e2404df-4f2d-4e7b-b784-495cd5b8918c tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:43.981121 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-4e2404df-4f2d-4e7b-b784-495cd5b8918c tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] [instance: 9020822d-a8c7-4fe5-a322-0be8f8148d52] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:43.987852 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4e2404df-4f2d-4e7b-b784-495cd5b8918c tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:43.988641 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4e2404df-4f2d-4e7b-b784-495cd5b8918c tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:43.989071 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4e2404df-4f2d-4e7b-b784-495cd5b8918c tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:43.989793 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4e2404df-4f2d-4e7b-b784-495cd5b8918c tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:43.990190 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4e2404df-4f2d-4e7b-b784-495cd5b8918c tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:43.990598 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-4e2404df-4f2d-4e7b-b784-495cd5b8918c tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:44.023949 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-4e2404df-4f2d-4e7b-b784-495cd5b8918c tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050107 Aug 09 11:28:44.024911 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 554/1132] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 9 11:28:43 2022] GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:28:44.324641 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-80741ae4-224d-4d70-92d1-77f75a5fa66a req-e2be195e-6351-4719-a511-435f288facfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9020822d-a8c7-4fe5-a322-0be8f8148d52", "tag": "2dac4157-7a6b-4a3a-9472-72b1cce67e96"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:28:44.335150 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-80741ae4-224d-4d70-92d1-77f75a5fa66a req-e2be195e-6351-4719-a511-435f288facfa service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:44.335629 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-80741ae4-224d-4d70-92d1-77f75a5fa66a req-e2be195e-6351-4719-a511-435f288facfa service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:44.336062 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-80741ae4-224d-4d70-92d1-77f75a5fa66a req-e2be195e-6351-4719-a511-435f288facfa service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:44.347740 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-80741ae4-224d-4d70-92d1-77f75a5fa66a req-e2be195e-6351-4719-a511-435f288facfa service nova] Creating event network-changed:2dac4157-7a6b-4a3a-9472-72b1cce67e96 for instance 9020822d-a8c7-4fe5-a322-0be8f8148d52 on hv-cinder-85251 Aug 09 11:28:44.352873 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-80741ae4-224d-4d70-92d1-77f75a5fa66a req-e2be195e-6351-4719-a511-435f288facfa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032846 Aug 09 11:28:44.353530 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 579/1133] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:28:45.040671 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-e0fa53dc-ecdb-42f3-a245-a2e58662364e tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:45.043613 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-e0fa53dc-ecdb-42f3-a245-a2e58662364e tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] [instance: 9020822d-a8c7-4fe5-a322-0be8f8148d52] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:45.053264 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e0fa53dc-ecdb-42f3-a245-a2e58662364e tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:45.053945 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e0fa53dc-ecdb-42f3-a245-a2e58662364e tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:45.054561 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e0fa53dc-ecdb-42f3-a245-a2e58662364e tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:45.055575 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e0fa53dc-ecdb-42f3-a245-a2e58662364e tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:45.056229 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e0fa53dc-ecdb-42f3-a245-a2e58662364e tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:45.056886 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-e0fa53dc-ecdb-42f3-a245-a2e58662364e tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:45.088629 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-e0fa53dc-ecdb-42f3-a245-a2e58662364e tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053941 Aug 09 11:28:45.089184 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 555/1134] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 9 11:28:45 2022] GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 11:28:45.104422 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-d4b333d2-e31d-43b4-b88d-74875e995a7c tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:45.105366 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-d4b333d2-e31d-43b4-b88d-74875e995a7c tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] [instance: 9020822d-a8c7-4fe5-a322-0be8f8148d52] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:45.114845 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d4b333d2-e31d-43b4-b88d-74875e995a7c tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:45.115628 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d4b333d2-e31d-43b4-b88d-74875e995a7c tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:45.116332 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d4b333d2-e31d-43b4-b88d-74875e995a7c tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:45.117459 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d4b333d2-e31d-43b4-b88d-74875e995a7c tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:45.118248 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d4b333d2-e31d-43b4-b88d-74875e995a7c tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:45.118911 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-d4b333d2-e31d-43b4-b88d-74875e995a7c tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:45.382353 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.wsgi [None req-d4b333d2-e31d-43b4-b88d-74875e995a7c tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] HTTP exception thrown: Instance 9020822d-a8c7-4fe5-a322-0be8f8148d52 is not attached to volume cc7f5501-8780-4eef-bdf1-6377f2024b06 Aug 09 11:28:45.384857 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-d4b333d2-e31d-43b4-b88d-74875e995a7c tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Request method failure captured: Aug 09 11:28:45.384857 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: request: DELETE /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52/os-volume_attachments/cc7f5501-8780-4eef-bdf1-6377f2024b06 HTTP/1.1 Aug 09 11:28:45.384857 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Accept: application/json Aug 09 11:28:45.384857 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Accept-Encoding: identity Aug 09 11:28:45.384857 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Connection: close Aug 09 11:28:45.384857 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Content-Length: 0 Aug 09 11:28:45.384857 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Content-Type: application/json Aug 09 11:28:45.384857 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Host: 10.222.0.27 Aug 09 11:28:45.384857 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Openstack-System-Scope: None Aug 09 11:28:45.384857 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: User-Agent: python-urllib3/1.26.11 Aug 09 11:28:45.384857 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Auth-Token: gAAAAABi8kRvEMgW_7c4sjzjQKM0ihGtPXSo7meWZgwF2Dl5XRgq5-JHL4OZLm6HskOF_QHGeaNU2KZ1QggGvFpF7Onsp7yTtFPPow5wNPfRkStsS17jwpchvUIXNOHqw0x6j3JFQgb2UPQ0-kBrAt-dL1zhUR3U1uULef6JhDPpPlx9JlMAtts Aug 09 11:28:45.384857 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Domain-Id: None Aug 09 11:28:45.384857 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Domain-Name: None Aug 09 11:28:45.384857 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Identity-Status: Confirmed Aug 09 11:28:45.384857 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Is-Admin-Project: True Aug 09 11:28:45.384857 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Domain-Id: default Aug 09 11:28:45.384857 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Domain-Name: Default Aug 09 11:28:45.384857 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Id: 2b3b0a56e9724ccd81df765dfc49739d Aug 09 11:28:45.384857 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Name: tempest-TestMinimumBasicScenario-359041046 Aug 09 11:28:45.384857 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Role: member,reader Aug 09 11:28:45.384857 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Roles: member,reader Aug 09 11:28:45.386573 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2b3b0a56e9724ccd81df765dfc49739d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2b3b0a56e9724ccd81df765dfc49739d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2b3b0a56e9724ccd81df765dfc49739d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2b3b0a56e9724ccd81df765dfc49739d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:28:45.386573 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant: tempest-TestMinimumBasicScenario-359041046 Aug 09 11:28:45.386573 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant-Id: 2b3b0a56e9724ccd81df765dfc49739d Aug 09 11:28:45.386573 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant-Name: tempest-TestMinimumBasicScenario-359041046 Aug 09 11:28:45.386573 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User: tempest-TestMinimumBasicScenario-359041046-project Aug 09 11:28:45.386573 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Domain-Id: default Aug 09 11:28:45.386573 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Domain-Name: Default Aug 09 11:28:45.386573 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Id: 909eaedf75674f88b41cbdc0eac33964 Aug 09 11:28:45.386573 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Name: tempest-TestMinimumBasicScenario-359041046-project Aug 09 11:28:45.386573 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: method: > Aug 09 11:28:45.386573 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: exception: Instance 9020822d-a8c7-4fe5-a322-0be8f8148d52 is not attached to volume cc7f5501-8780-4eef-bdf1-6377f2024b06 Aug 09 11:28:45.387651 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: action_args: {'server_id': '9020822d-a8c7-4fe5-a322-0be8f8148d52', 'id': 'cc7f5501-8780-4eef-bdf1-6377f2024b06'} Aug 09 11:28:45.387651 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:28:45.387651 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:28:45.387651 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 09 11:28:45.387651 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 09 11:28:45.387651 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 11:28:45.387651 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 11:28:45.387651 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 09 11:28:45.387651 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 09 11:28:45.387651 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id cc7f5501-8780-4eef-bdf1-6377f2024b06. Aug 09 11:28:45.387651 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:28:45.387651 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:28:45.387651 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:28:45.387651 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:28:45.387651 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:28:45.387651 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:28:45.387651 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:28:45.387651 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:28:45.387651 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:28:45.389348 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:28:45.389348 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 09 11:28:45.389348 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 09 11:28:45.389348 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9020822d-a8c7-4fe5-a322-0be8f8148d52 is not attached to volume cc7f5501-8780-4eef-bdf1-6377f2024b06 Aug 09 11:28:45.389348 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:28:45.389348 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:28:45.389348 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:28:45.389348 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:28:45.389348 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:28:45.389348 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:28:45.389348 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:28:45.389348 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:28:45.389348 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9020822d-a8c7-4fe5-a322-0be8f8148d52 is not attached to volume cc7f5501-8780-4eef-bdf1-6377f2024b06 Aug 09 11:28:45.389348 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:28:45.389348 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-d4b333d2-e31d-43b4-b88d-74875e995a7c tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Returning 404 to user: Instance 9020822d-a8c7-4fe5-a322-0be8f8148d52 is not attached to volume cc7f5501-8780-4eef-bdf1-6377f2024b06 {{(pid=117685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:28:45.390646 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-d4b333d2-e31d-43b4-b88d-74875e995a7c tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52/os-volume_attachments/cc7f5501-8780-4eef-bdf1-6377f2024b06" status: 404 len: 154 microversion: 2.1 time: 0.289877 Aug 09 11:28:45.390646 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 580/1135] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Aug 9 11:28:45 2022] DELETE /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52/os-volume_attachments/cc7f5501-8780-4eef-bdf1-6377f2024b06 => generated 154 bytes in 292 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:28:46.541402 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-f14c623a-d20e-4dec-a837-e815cf4bb5cc tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:46.541951 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-f14c623a-d20e-4dec-a837-e815cf4bb5cc tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] [instance: 9020822d-a8c7-4fe5-a322-0be8f8148d52] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:46.548743 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f14c623a-d20e-4dec-a837-e815cf4bb5cc tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:46.549224 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f14c623a-d20e-4dec-a837-e815cf4bb5cc tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:46.550223 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f14c623a-d20e-4dec-a837-e815cf4bb5cc tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:46.550924 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f14c623a-d20e-4dec-a837-e815cf4bb5cc tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:46.551377 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f14c623a-d20e-4dec-a837-e815cf4bb5cc tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:46.551797 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f14c623a-d20e-4dec-a837-e815cf4bb5cc tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:46.577347 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-f14c623a-d20e-4dec-a837-e815cf4bb5cc tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] [instance: 9020822d-a8c7-4fe5-a322-0be8f8148d52] Going to try to terminate instance {{(pid=117684) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 11:28:46.664803 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-f14c623a-d20e-4dec-a837-e815cf4bb5cc tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52" status: 204 len: 0 microversion: 2.1 time: 0.126946 Aug 09 11:28:46.665378 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 556/1136] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 9 11:28:46 2022] DELETE /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 11:28:46.674502 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-082dcb87-9fa0-4b7d-af1b-9e87a3fe6e0b tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:46.675198 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-082dcb87-9fa0-4b7d-af1b-9e87a3fe6e0b tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] [instance: 9020822d-a8c7-4fe5-a322-0be8f8148d52] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:46.684197 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-082dcb87-9fa0-4b7d-af1b-9e87a3fe6e0b tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:46.684820 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-082dcb87-9fa0-4b7d-af1b-9e87a3fe6e0b tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:46.685263 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-082dcb87-9fa0-4b7d-af1b-9e87a3fe6e0b tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:46.685970 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-082dcb87-9fa0-4b7d-af1b-9e87a3fe6e0b tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:46.686408 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-082dcb87-9fa0-4b7d-af1b-9e87a3fe6e0b tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:46.686832 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-082dcb87-9fa0-4b7d-af1b-9e87a3fe6e0b tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:46.818690 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-082dcb87-9fa0-4b7d-af1b-9e87a3fe6e0b tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909eaedf75674f88b41cbdc0eac33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b0a56e9724ccd81df765dfc49739d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:46.826374 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-082dcb87-9fa0-4b7d-af1b-9e87a3fe6e0b tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52" status: 200 len: 1553 microversion: 2.1 time: 0.156040 Aug 09 11:28:46.826934 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 581/1137] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:46 2022] GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52 => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:47.849633 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-2d2d66ca-bd8e-4309-aead-6b997173e0b0 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:47.850305 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-2d2d66ca-bd8e-4309-aead-6b997173e0b0 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] [instance: 9020822d-a8c7-4fe5-a322-0be8f8148d52] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:47.857320 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2d2d66ca-bd8e-4309-aead-6b997173e0b0 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:47.857795 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2d2d66ca-bd8e-4309-aead-6b997173e0b0 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:47.858216 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2d2d66ca-bd8e-4309-aead-6b997173e0b0 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:47.858900 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2d2d66ca-bd8e-4309-aead-6b997173e0b0 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:47.859340 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2d2d66ca-bd8e-4309-aead-6b997173e0b0 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:47.859756 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-2d2d66ca-bd8e-4309-aead-6b997173e0b0 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:47.997553 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-2d2d66ca-bd8e-4309-aead-6b997173e0b0 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909eaedf75674f88b41cbdc0eac33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b0a56e9724ccd81df765dfc49739d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:48.007063 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-2d2d66ca-bd8e-4309-aead-6b997173e0b0 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52" status: 200 len: 1553 microversion: 2.1 time: 0.162655 Aug 09 11:28:48.007642 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 557/1138] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:47 2022] GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52 => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:49.030338 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-f404e130-58ee-4bcc-ae99-f0a2ba93916f tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:49.031961 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-f404e130-58ee-4bcc-ae99-f0a2ba93916f tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] [instance: 9020822d-a8c7-4fe5-a322-0be8f8148d52] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:49.040259 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [req-2a711f31-ee1c-4156-b62c-1efc848a9952 req-c2015f95-493f-41e1-8597-fe7ecdd3de89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9020822d-a8c7-4fe5-a322-0be8f8148d52", "name": "network-vif-deleted", "tag": "2dac4157-7a6b-4a3a-9472-72b1cce67e96"}]} {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:28:49.047428 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f404e130-58ee-4bcc-ae99-f0a2ba93916f tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:49.048053 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f404e130-58ee-4bcc-ae99-f0a2ba93916f tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:49.048540 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f404e130-58ee-4bcc-ae99-f0a2ba93916f tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:49.049237 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f404e130-58ee-4bcc-ae99-f0a2ba93916f tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:49.049677 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f404e130-58ee-4bcc-ae99-f0a2ba93916f tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:49.049803 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-2a711f31-ee1c-4156-b62c-1efc848a9952 req-c2015f95-493f-41e1-8597-fe7ecdd3de89 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:49.050108 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-f404e130-58ee-4bcc-ae99-f0a2ba93916f tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:49.050245 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-2a711f31-ee1c-4156-b62c-1efc848a9952 req-c2015f95-493f-41e1-8597-fe7ecdd3de89 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:49.050603 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [req-2a711f31-ee1c-4156-b62c-1efc848a9952 req-c2015f95-493f-41e1-8597-fe7ecdd3de89 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:49.062732 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.compute.server_external_events [req-2a711f31-ee1c-4156-b62c-1efc848a9952 req-c2015f95-493f-41e1-8597-fe7ecdd3de89 service nova] Creating event network-vif-deleted:2dac4157-7a6b-4a3a-9472-72b1cce67e96 for instance 9020822d-a8c7-4fe5-a322-0be8f8148d52 on hv-cinder-85251 Aug 09 11:28:49.067984 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [req-2a711f31-ee1c-4156-b62c-1efc848a9952 req-c2015f95-493f-41e1-8597-fe7ecdd3de89 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093323 Aug 09 11:28:49.068867 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 582/1139] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:28:49.118179 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-f404e130-58ee-4bcc-ae99-f0a2ba93916f tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909eaedf75674f88b41cbdc0eac33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b0a56e9724ccd81df765dfc49739d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:49.125920 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-f404e130-58ee-4bcc-ae99-f0a2ba93916f tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52" status: 200 len: 1343 microversion: 2.1 time: 0.101035 Aug 09 11:28:49.126487 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 558/1140] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:49 2022] GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52 => generated 1343 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:28:50.148082 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-c06008f3-cc7d-42c9-ae90-322d520b3720 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:50.148799 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-c06008f3-cc7d-42c9-ae90-322d520b3720 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] [instance: 9020822d-a8c7-4fe5-a322-0be8f8148d52] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:50.155429 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c06008f3-cc7d-42c9-ae90-322d520b3720 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:50.155908 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c06008f3-cc7d-42c9-ae90-322d520b3720 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:50.156369 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c06008f3-cc7d-42c9-ae90-322d520b3720 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:50.157055 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c06008f3-cc7d-42c9-ae90-322d520b3720 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:50.157491 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c06008f3-cc7d-42c9-ae90-322d520b3720 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:50.157903 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-c06008f3-cc7d-42c9-ae90-322d520b3720 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:50.171459 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.wsgi [None req-c06008f3-cc7d-42c9-ae90-322d520b3720 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] HTTP exception thrown: Instance 9020822d-a8c7-4fe5-a322-0be8f8148d52 could not be found. Aug 09 11:28:50.173126 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-c06008f3-cc7d-42c9-ae90-322d520b3720 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Request method failure captured: Aug 09 11:28:50.173126 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: request: GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52 HTTP/1.1 Aug 09 11:28:50.173126 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Accept: application/json Aug 09 11:28:50.173126 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Accept-Encoding: identity Aug 09 11:28:50.173126 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Connection: close Aug 09 11:28:50.173126 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Content-Length: 0 Aug 09 11:28:50.173126 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Content-Type: application/json Aug 09 11:28:50.173126 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Host: 10.222.0.27 Aug 09 11:28:50.173126 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Openstack-System-Scope: None Aug 09 11:28:50.173126 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: User-Agent: python-urllib3/1.26.11 Aug 09 11:28:50.173126 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Auth-Token: gAAAAABi8kRvEMgW_7c4sjzjQKM0ihGtPXSo7meWZgwF2Dl5XRgq5-JHL4OZLm6HskOF_QHGeaNU2KZ1QggGvFpF7Onsp7yTtFPPow5wNPfRkStsS17jwpchvUIXNOHqw0x6j3JFQgb2UPQ0-kBrAt-dL1zhUR3U1uULef6JhDPpPlx9JlMAtts Aug 09 11:28:50.173126 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Domain-Id: None Aug 09 11:28:50.173126 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Domain-Name: None Aug 09 11:28:50.173126 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Identity-Status: Confirmed Aug 09 11:28:50.173126 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Is-Admin-Project: True Aug 09 11:28:50.173126 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Domain-Id: default Aug 09 11:28:50.173126 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Domain-Name: Default Aug 09 11:28:50.173126 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Id: 2b3b0a56e9724ccd81df765dfc49739d Aug 09 11:28:50.173126 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Name: tempest-TestMinimumBasicScenario-359041046 Aug 09 11:28:50.173126 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Role: member,reader Aug 09 11:28:50.173126 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Roles: member,reader Aug 09 11:28:50.174754 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2b3b0a56e9724ccd81df765dfc49739d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2b3b0a56e9724ccd81df765dfc49739d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2b3b0a56e9724ccd81df765dfc49739d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2b3b0a56e9724ccd81df765dfc49739d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:28:50.174754 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant: tempest-TestMinimumBasicScenario-359041046 Aug 09 11:28:50.174754 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant-Id: 2b3b0a56e9724ccd81df765dfc49739d Aug 09 11:28:50.174754 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant-Name: tempest-TestMinimumBasicScenario-359041046 Aug 09 11:28:50.174754 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User: tempest-TestMinimumBasicScenario-359041046-project Aug 09 11:28:50.174754 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Domain-Id: default Aug 09 11:28:50.174754 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Domain-Name: Default Aug 09 11:28:50.174754 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Id: 909eaedf75674f88b41cbdc0eac33964 Aug 09 11:28:50.174754 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Name: tempest-TestMinimumBasicScenario-359041046-project Aug 09 11:28:50.174754 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: method: > Aug 09 11:28:50.174754 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: exception: Instance 9020822d-a8c7-4fe5-a322-0be8f8148d52 could not be found. Aug 09 11:28:50.174754 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: action_args: {'id': '9020822d-a8c7-4fe5-a322-0be8f8148d52'} Aug 09 11:28:50.175987 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:28:50.175987 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:28:50.175987 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:28:50.175987 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:28:50.175987 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:28:50.175987 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:28:50.175987 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:28:50.175987 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:28:50.175987 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:28:50.175987 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:28:50.175987 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9020822d-a8c7-4fe5-a322-0be8f8148d52 could not be found. Aug 09 11:28:50.175987 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:28:50.175987 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:28:50.175987 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:28:50.175987 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:28:50.175987 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:28:50.175987 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:28:50.175987 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:28:50.175987 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:28:50.175987 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:28:50.177722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:28:50.177722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:28:50.177722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:28:50.177722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:28:50.177722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:28:50.177722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:28:50.177722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:28:50.177722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9020822d-a8c7-4fe5-a322-0be8f8148d52 could not be found. Aug 09 11:28:50.177722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:28:50.177722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:28:50.177722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:28:50.177722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:28:50.177722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:28:50.177722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:28:50.177722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:28:50.177722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:28:50.177722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9020822d-a8c7-4fe5-a322-0be8f8148d52 could not be found. Aug 09 11:28:50.177722 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:28:50.179761 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-c06008f3-cc7d-42c9-ae90-322d520b3720 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Returning 404 to user: Instance 9020822d-a8c7-4fe5-a322-0be8f8148d52 could not be found. {{(pid=117685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:28:50.179761 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-c06008f3-cc7d-42c9-ae90-322d520b3720 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52" status: 404 len: 111 microversion: 2.1 time: 0.031280 Aug 09 11:28:50.179761 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 583/1141] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:50 2022] GET /compute/v2.1/servers/9020822d-a8c7-4fe5-a322-0be8f8148d52 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:28:50.183493 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-decdb6e7-076b-410c-97c3-dbadf48c3888 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] Calling method '.version_select at 0x7f28220263a0>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:50.205211 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-decdb6e7-076b-410c-97c3-dbadf48c3888 tempest-TestMinimumBasicScenario-359041046 tempest-TestMinimumBasicScenario-359041046-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1294905069" status: 202 len: 0 microversion: 2.1 time: 0.025608 Aug 09 11:28:50.205772 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 559/1142] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Aug 9 11:28:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1294905069 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:29:43.239269 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 11:29:43.240102 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Tue Aug 9 11:29:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 11:30:04.939771 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-0a507f9a-a370-4b48-89e9-76168fe7547c tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:30:04.940376 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:30:04.940760 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-0a507f9a-a370-4b48-89e9-76168fe7547c tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 5ccbdf55-3c9d-49f6-b3fd-50e822069991] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:30:04.941232 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG dbcounter [-] [117684] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:30:04.942617 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_api:SELECT=14 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:30:04.943869 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG dbcounter [-] [117685] Writing DB stats nova_cell1:SELECT=66,nova_cell1:INSERT=1 {{(pid=117685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:30:04.946707 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [req-75638c8c-95e8-4b6a-adbc-8a2125f358e7 req-39694664-2d0b-41af-8be9-a3bb62dbead2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ccbdf55-3c9d-49f6-b3fd-50e822069991", "tag": "7b96ad0e-09d6-4e0a-ae5a-f88b0bcce574"}]} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:30:04.949355 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0a507f9a-a370-4b48-89e9-76168fe7547c tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:04.949845 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0a507f9a-a370-4b48-89e9-76168fe7547c tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:04.950275 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0a507f9a-a370-4b48-89e9-76168fe7547c tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:04.951014 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0a507f9a-a370-4b48-89e9-76168fe7547c tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:04.951448 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0a507f9a-a370-4b48-89e9-76168fe7547c tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:04.951894 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-0a507f9a-a370-4b48-89e9-76168fe7547c tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:04.959034 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-75638c8c-95e8-4b6a-adbc-8a2125f358e7 req-39694664-2d0b-41af-8be9-a3bb62dbead2 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:04.959548 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-75638c8c-95e8-4b6a-adbc-8a2125f358e7 req-39694664-2d0b-41af-8be9-a3bb62dbead2 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:04.959924 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-75638c8c-95e8-4b6a-adbc-8a2125f358e7 req-39694664-2d0b-41af-8be9-a3bb62dbead2 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:04.972229 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.compute.server_external_events [req-75638c8c-95e8-4b6a-adbc-8a2125f358e7 req-39694664-2d0b-41af-8be9-a3bb62dbead2 service nova] Creating event network-changed:7b96ad0e-09d6-4e0a-ae5a-f88b0bcce574 for instance 5ccbdf55-3c9d-49f6-b3fd-50e822069991 on hv-cinder-85251 Aug 09 11:30:04.977948 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [req-75638c8c-95e8-4b6a-adbc-8a2125f358e7 req-39694664-2d0b-41af-8be9-a3bb62dbead2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039834 Aug 09 11:30:04.978906 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 560/1143] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:30:04.980811 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-0a507f9a-a370-4b48-89e9-76168fe7547c tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 5ccbdf55-3c9d-49f6-b3fd-50e822069991] Going to try to terminate instance {{(pid=117685) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 11:30:05.072468 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-0a507f9a-a370-4b48-89e9-76168fe7547c tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5ccbdf55-3c9d-49f6-b3fd-50e822069991" status: 204 len: 0 microversion: 2.1 time: 0.137506 Aug 09 11:30:05.077995 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 584/1144] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 9 11:30:04 2022] DELETE /compute/v2.1/servers/5ccbdf55-3c9d-49f6-b3fd-50e822069991 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 11:30:05.083979 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-85665ece-b2ef-42b8-a9ee-04404e570eda tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:30:05.084876 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-85665ece-b2ef-42b8-a9ee-04404e570eda tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 5ccbdf55-3c9d-49f6-b3fd-50e822069991] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:30:05.092005 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-85665ece-b2ef-42b8-a9ee-04404e570eda tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:05.092842 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-85665ece-b2ef-42b8-a9ee-04404e570eda tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:05.093277 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-85665ece-b2ef-42b8-a9ee-04404e570eda tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:05.093971 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-85665ece-b2ef-42b8-a9ee-04404e570eda tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:05.094415 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-85665ece-b2ef-42b8-a9ee-04404e570eda tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:05.095016 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-85665ece-b2ef-42b8-a9ee-04404e570eda tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:05.233812 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-85665ece-b2ef-42b8-a9ee-04404e570eda tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:30:05.241830 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-85665ece-b2ef-42b8-a9ee-04404e570eda tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/5ccbdf55-3c9d-49f6-b3fd-50e822069991" status: 200 len: 1578 microversion: 2.1 time: 0.163467 Aug 09 11:30:05.242604 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 561/1145] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:30:05 2022] GET /compute/v2.1/servers/5ccbdf55-3c9d-49f6-b3fd-50e822069991 => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:30:06.267240 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-f9991c14-db18-419d-bf43-04b6db703cde tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:30:06.268597 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-f9991c14-db18-419d-bf43-04b6db703cde tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 5ccbdf55-3c9d-49f6-b3fd-50e822069991] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:30:06.280333 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f9991c14-db18-419d-bf43-04b6db703cde tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:06.281200 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f9991c14-db18-419d-bf43-04b6db703cde tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:06.282218 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f9991c14-db18-419d-bf43-04b6db703cde tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:06.283157 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f9991c14-db18-419d-bf43-04b6db703cde tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:06.283777 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f9991c14-db18-419d-bf43-04b6db703cde tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:06.284439 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-f9991c14-db18-419d-bf43-04b6db703cde tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:06.450642 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-f9991c14-db18-419d-bf43-04b6db703cde tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:30:06.458760 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-f9991c14-db18-419d-bf43-04b6db703cde tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/5ccbdf55-3c9d-49f6-b3fd-50e822069991" status: 200 len: 1578 microversion: 2.1 time: 0.198318 Aug 09 11:30:06.459341 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 585/1146] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:30:06 2022] GET /compute/v2.1/servers/5ccbdf55-3c9d-49f6-b3fd-50e822069991 => generated 1578 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:30:07.132814 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [req-b7c462f6-d6cf-48bc-873a-a068fe6f54f8 req-c4114948-eedf-4857-b820-7ceccd53e6a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ccbdf55-3c9d-49f6-b3fd-50e822069991", "name": "network-vif-deleted", "tag": "7b96ad0e-09d6-4e0a-ae5a-f88b0bcce574"}]} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:30:07.148091 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-b7c462f6-d6cf-48bc-873a-a068fe6f54f8 req-c4114948-eedf-4857-b820-7ceccd53e6a0 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:07.148857 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-b7c462f6-d6cf-48bc-873a-a068fe6f54f8 req-c4114948-eedf-4857-b820-7ceccd53e6a0 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:07.149281 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-b7c462f6-d6cf-48bc-873a-a068fe6f54f8 req-c4114948-eedf-4857-b820-7ceccd53e6a0 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:07.162633 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.compute.server_external_events [req-b7c462f6-d6cf-48bc-873a-a068fe6f54f8 req-c4114948-eedf-4857-b820-7ceccd53e6a0 service nova] Creating event network-vif-deleted:7b96ad0e-09d6-4e0a-ae5a-f88b0bcce574 for instance 5ccbdf55-3c9d-49f6-b3fd-50e822069991 on hv-cinder-85251 Aug 09 11:30:07.167466 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [req-b7c462f6-d6cf-48bc-873a-a068fe6f54f8 req-c4114948-eedf-4857-b820-7ceccd53e6a0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038349 Aug 09 11:30:07.168032 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 562/1147] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:30:07.480854 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-95dea836-d9fb-4e81-a4b5-0326d1dbcee1 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:30:07.481473 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-95dea836-d9fb-4e81-a4b5-0326d1dbcee1 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 5ccbdf55-3c9d-49f6-b3fd-50e822069991] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:30:07.487839 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-95dea836-d9fb-4e81-a4b5-0326d1dbcee1 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:07.488589 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-95dea836-d9fb-4e81-a4b5-0326d1dbcee1 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:07.489020 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-95dea836-d9fb-4e81-a4b5-0326d1dbcee1 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:07.489716 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-95dea836-d9fb-4e81-a4b5-0326d1dbcee1 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:07.490162 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-95dea836-d9fb-4e81-a4b5-0326d1dbcee1 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:07.490571 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-95dea836-d9fb-4e81-a4b5-0326d1dbcee1 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:07.524531 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-95dea836-d9fb-4e81-a4b5-0326d1dbcee1 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:07.525363 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-95dea836-d9fb-4e81-a4b5-0326d1dbcee1 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:07.525788 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-95dea836-d9fb-4e81-a4b5-0326d1dbcee1 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:07.526228 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.objects.instance [None req-95dea836-d9fb-4e81-a4b5-0326d1dbcee1 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lazy-loading 'fault' on Instance uuid 5ccbdf55-3c9d-49f6-b3fd-50e822069991 {{(pid=117685) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:30:07.568438 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-95dea836-d9fb-4e81-a4b5-0326d1dbcee1 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:30:07.576584 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-95dea836-d9fb-4e81-a4b5-0326d1dbcee1 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/5ccbdf55-3c9d-49f6-b3fd-50e822069991" status: 200 len: 1230 microversion: 2.1 time: 0.100310 Aug 09 11:30:07.577196 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 586/1148] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:30:07 2022] GET /compute/v2.1/servers/5ccbdf55-3c9d-49f6-b3fd-50e822069991 => generated 1230 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:30:08.601199 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-6ecd6b6b-4cdc-4479-96fa-ad711ee09c53 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:30:08.601882 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-6ecd6b6b-4cdc-4479-96fa-ad711ee09c53 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 5ccbdf55-3c9d-49f6-b3fd-50e822069991] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:30:08.610626 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6ecd6b6b-4cdc-4479-96fa-ad711ee09c53 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:08.611522 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6ecd6b6b-4cdc-4479-96fa-ad711ee09c53 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:08.612131 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6ecd6b6b-4cdc-4479-96fa-ad711ee09c53 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:08.613127 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6ecd6b6b-4cdc-4479-96fa-ad711ee09c53 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:08.613753 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6ecd6b6b-4cdc-4479-96fa-ad711ee09c53 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:08.614340 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-6ecd6b6b-4cdc-4479-96fa-ad711ee09c53 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:08.631974 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.wsgi [None req-6ecd6b6b-4cdc-4479-96fa-ad711ee09c53 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] HTTP exception thrown: Instance 5ccbdf55-3c9d-49f6-b3fd-50e822069991 could not be found. Aug 09 11:30:08.633632 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-6ecd6b6b-4cdc-4479-96fa-ad711ee09c53 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Request method failure captured: Aug 09 11:30:08.633632 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: request: GET /compute/v2.1/servers/5ccbdf55-3c9d-49f6-b3fd-50e822069991 HTTP/1.1 Aug 09 11:30:08.633632 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept: application/json Aug 09 11:30:08.633632 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept-Encoding: identity Aug 09 11:30:08.633632 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Connection: close Aug 09 11:30:08.633632 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Length: 0 Aug 09 11:30:08.633632 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Type: application/json Aug 09 11:30:08.633632 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Host: 10.222.0.27 Aug 09 11:30:08.633632 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Openstack-System-Scope: None Aug 09 11:30:08.633632 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: User-Agent: python-urllib3/1.26.11 Aug 09 11:30:08.633632 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Auth-Token: gAAAAABi8kOSqBDhhheNHFXQC96sdrHL714LO7y9IM1Cd2MzmODs85Pa0AMSSTdl7t1_D4T9ywKgKiyJRwch62n-k-E0Cc5pubZWfo5TMk-U3KI3XaWUhA4CgUdKGTMgQkLSjcw22aBZmAyFdNDBnv73AYrYgmma8uR2-CCpbr5WgbSXeHOiK9A Aug 09 11:30:08.633632 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Id: None Aug 09 11:30:08.633632 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Name: None Aug 09 11:30:08.633632 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Identity-Status: Confirmed Aug 09 11:30:08.633632 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Is-Admin-Project: True Aug 09 11:30:08.633632 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Id: default Aug 09 11:30:08.633632 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Name: Default Aug 09 11:30:08.633632 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Id: bfd671fcff7e4b24b5415a3a1b70ad0f Aug 09 11:30:08.633632 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Name: tempest-TestVolumeBootPattern-2035807174 Aug 09 11:30:08.633632 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Role: member,reader Aug 09 11:30:08.633632 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Roles: member,reader Aug 09 11:30:08.635390 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bfd671fcff7e4b24b5415a3a1b70ad0f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bfd671fcff7e4b24b5415a3a1b70ad0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bfd671fcff7e4b24b5415a3a1b70ad0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bfd671fcff7e4b24b5415a3a1b70ad0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:30:08.635390 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant: tempest-TestVolumeBootPattern-2035807174 Aug 09 11:30:08.635390 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Id: bfd671fcff7e4b24b5415a3a1b70ad0f Aug 09 11:30:08.635390 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Name: tempest-TestVolumeBootPattern-2035807174 Aug 09 11:30:08.635390 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User: tempest-TestVolumeBootPattern-2035807174-project Aug 09 11:30:08.635390 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Id: default Aug 09 11:30:08.635390 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Name: Default Aug 09 11:30:08.635390 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Id: 5b4c4030b5fb4381a598a54588880b75 Aug 09 11:30:08.635390 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Name: tempest-TestVolumeBootPattern-2035807174-project Aug 09 11:30:08.635390 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: method: > Aug 09 11:30:08.635390 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: exception: Instance 5ccbdf55-3c9d-49f6-b3fd-50e822069991 could not be found. Aug 09 11:30:08.635390 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: action_args: {'id': '5ccbdf55-3c9d-49f6-b3fd-50e822069991'} Aug 09 11:30:08.636425 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:30:08.636425 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:30:08.636425 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:30:08.636425 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:30:08.636425 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:30:08.636425 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:30:08.636425 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:30:08.636425 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:30:08.636425 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:30:08.636425 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:30:08.636425 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ccbdf55-3c9d-49f6-b3fd-50e822069991 could not be found. Aug 09 11:30:08.636425 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:30:08.636425 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:30:08.636425 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:30:08.636425 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:30:08.636425 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:30:08.636425 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:30:08.636425 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:30:08.636425 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:30:08.636425 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:30:08.638148 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:30:08.638148 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:30:08.638148 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:30:08.638148 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:30:08.638148 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:30:08.638148 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:30:08.638148 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:30:08.638148 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ccbdf55-3c9d-49f6-b3fd-50e822069991 could not be found. Aug 09 11:30:08.638148 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:30:08.638148 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:30:08.638148 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:30:08.638148 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:30:08.638148 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:30:08.638148 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:30:08.638148 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:30:08.638148 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:30:08.638148 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ccbdf55-3c9d-49f6-b3fd-50e822069991 could not be found. Aug 09 11:30:08.638148 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:30:08.639611 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-6ecd6b6b-4cdc-4479-96fa-ad711ee09c53 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Returning 404 to user: Instance 5ccbdf55-3c9d-49f6-b3fd-50e822069991 could not be found. {{(pid=117684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:30:08.639611 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-6ecd6b6b-4cdc-4479-96fa-ad711ee09c53 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/5ccbdf55-3c9d-49f6-b3fd-50e822069991" status: 404 len: 111 microversion: 2.1 time: 0.039311 Aug 09 11:30:08.639611 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 563/1149] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:30:08 2022] GET /compute/v2.1/servers/5ccbdf55-3c9d-49f6-b3fd-50e822069991 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:30:11.759095 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [req-fde78b46-0e60-4a07-bc84-e55462df2bd9 req-4d24e02a-ba7d-4b09-af8d-527962f9bd15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26cff99f-ec69-43f4-b0be-dda5ce2ccd51", "tag": "78730e1b-ce01-4a35-9f7e-01c214a347ad"}]} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:30:11.765872 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-68cf0e01-0d73-49ab-b79f-74ec4a56e1b5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:30:11.767698 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-68cf0e01-0d73-49ab-b79f-74ec4a56e1b5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 26cff99f-ec69-43f4-b0be-dda5ce2ccd51] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:30:11.772148 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-fde78b46-0e60-4a07-bc84-e55462df2bd9 req-4d24e02a-ba7d-4b09-af8d-527962f9bd15 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:11.772766 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-fde78b46-0e60-4a07-bc84-e55462df2bd9 req-4d24e02a-ba7d-4b09-af8d-527962f9bd15 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:11.773419 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-fde78b46-0e60-4a07-bc84-e55462df2bd9 req-4d24e02a-ba7d-4b09-af8d-527962f9bd15 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:11.780323 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-68cf0e01-0d73-49ab-b79f-74ec4a56e1b5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:11.781058 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-68cf0e01-0d73-49ab-b79f-74ec4a56e1b5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:11.781639 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-68cf0e01-0d73-49ab-b79f-74ec4a56e1b5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:11.782338 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-68cf0e01-0d73-49ab-b79f-74ec4a56e1b5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:11.782941 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-68cf0e01-0d73-49ab-b79f-74ec4a56e1b5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:11.783354 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-68cf0e01-0d73-49ab-b79f-74ec4a56e1b5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:11.791265 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.compute.server_external_events [req-fde78b46-0e60-4a07-bc84-e55462df2bd9 req-4d24e02a-ba7d-4b09-af8d-527962f9bd15 service nova] Creating event network-changed:78730e1b-ce01-4a35-9f7e-01c214a347ad for instance 26cff99f-ec69-43f4-b0be-dda5ce2ccd51 on hv-cinder-85251 Aug 09 11:30:11.799818 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [req-fde78b46-0e60-4a07-bc84-e55462df2bd9 req-4d24e02a-ba7d-4b09-af8d-527962f9bd15 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044391 Aug 09 11:30:11.801161 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 564/1150] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:30:11.814071 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-68cf0e01-0d73-49ab-b79f-74ec4a56e1b5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 26cff99f-ec69-43f4-b0be-dda5ce2ccd51] Going to try to terminate instance {{(pid=117685) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 11:30:11.923629 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-68cf0e01-0d73-49ab-b79f-74ec4a56e1b5 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "DELETE /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51" status: 204 len: 0 microversion: 2.1 time: 0.163893 Aug 09 11:30:11.925637 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 587/1151] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 9 11:30:11 2022] DELETE /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 11:30:11.936698 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-5d3d589d-cf69-4eb9-875e-a905337ffb77 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:30:11.937837 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-5d3d589d-cf69-4eb9-875e-a905337ffb77 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 26cff99f-ec69-43f4-b0be-dda5ce2ccd51] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:30:11.949577 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5d3d589d-cf69-4eb9-875e-a905337ffb77 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:11.950581 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5d3d589d-cf69-4eb9-875e-a905337ffb77 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:11.951286 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5d3d589d-cf69-4eb9-875e-a905337ffb77 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:11.952511 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5d3d589d-cf69-4eb9-875e-a905337ffb77 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:11.953298 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5d3d589d-cf69-4eb9-875e-a905337ffb77 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:11.953954 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-5d3d589d-cf69-4eb9-875e-a905337ffb77 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:12.103110 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.policy [None req-5d3d589d-cf69-4eb9-875e-a905337ffb77 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117684) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:30:12.113220 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-5d3d589d-cf69-4eb9-875e-a905337ffb77 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51" status: 200 len: 1579 microversion: 2.1 time: 0.182572 Aug 09 11:30:12.113800 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 565/1152] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:30:11 2022] GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51 => generated 1579 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:30:13.135095 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-64c4650d-5b49-472b-8c2a-6953c994e64b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:30:13.135922 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-64c4650d-5b49-472b-8c2a-6953c994e64b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 26cff99f-ec69-43f4-b0be-dda5ce2ccd51] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:30:13.143469 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-64c4650d-5b49-472b-8c2a-6953c994e64b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:13.144179 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-64c4650d-5b49-472b-8c2a-6953c994e64b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:13.144648 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-64c4650d-5b49-472b-8c2a-6953c994e64b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:13.145345 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-64c4650d-5b49-472b-8c2a-6953c994e64b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:13.145787 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-64c4650d-5b49-472b-8c2a-6953c994e64b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:13.146196 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-64c4650d-5b49-472b-8c2a-6953c994e64b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:13.282389 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-64c4650d-5b49-472b-8c2a-6953c994e64b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:30:13.291200 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-64c4650d-5b49-472b-8c2a-6953c994e64b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51" status: 200 len: 1579 microversion: 2.1 time: 0.160346 Aug 09 11:30:13.291772 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 588/1153] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:30:13 2022] GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51 => generated 1579 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:30:13.844925 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [req-a9f1d3f0-a9e2-4cdc-8760-cf8db497954d req-85a50ac9-d003-4c99-99a4-f34b15c83638 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26cff99f-ec69-43f4-b0be-dda5ce2ccd51", "name": "network-vif-deleted", "tag": "78730e1b-ce01-4a35-9f7e-01c214a347ad"}]} {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:30:13.855190 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-a9f1d3f0-a9e2-4cdc-8760-cf8db497954d req-85a50ac9-d003-4c99-99a4-f34b15c83638 service nova] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:13.855661 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-a9f1d3f0-a9e2-4cdc-8760-cf8db497954d req-85a50ac9-d003-4c99-99a4-f34b15c83638 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:13.856143 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [req-a9f1d3f0-a9e2-4cdc-8760-cf8db497954d req-85a50ac9-d003-4c99-99a4-f34b15c83638 service nova] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:13.869609 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.compute.server_external_events [req-a9f1d3f0-a9e2-4cdc-8760-cf8db497954d req-85a50ac9-d003-4c99-99a4-f34b15c83638 service nova] Creating event network-vif-deleted:78730e1b-ce01-4a35-9f7e-01c214a347ad for instance 26cff99f-ec69-43f4-b0be-dda5ce2ccd51 on hv-cinder-85251 Aug 09 11:30:13.874505 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [req-a9f1d3f0-a9e2-4cdc-8760-cf8db497954d req-85a50ac9-d003-4c99-99a4-f34b15c83638 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033320 Aug 09 11:30:13.875181 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 566/1154] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 9 11:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:30:14.316415 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-6df05e87-ea09-4b81-87cf-ec17904ad499 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:30:14.317694 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-6df05e87-ea09-4b81-87cf-ec17904ad499 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 26cff99f-ec69-43f4-b0be-dda5ce2ccd51] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:30:14.324584 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6df05e87-ea09-4b81-87cf-ec17904ad499 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:14.325062 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6df05e87-ea09-4b81-87cf-ec17904ad499 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:14.325488 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6df05e87-ea09-4b81-87cf-ec17904ad499 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:14.326205 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6df05e87-ea09-4b81-87cf-ec17904ad499 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:14.326648 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6df05e87-ea09-4b81-87cf-ec17904ad499 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:14.327065 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6df05e87-ea09-4b81-87cf-ec17904ad499 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:14.363924 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6df05e87-ea09-4b81-87cf-ec17904ad499 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:14.364348 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6df05e87-ea09-4b81-87cf-ec17904ad499 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:14.364843 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-6df05e87-ea09-4b81-87cf-ec17904ad499 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:14.365479 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.objects.instance [None req-6df05e87-ea09-4b81-87cf-ec17904ad499 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lazy-loading 'fault' on Instance uuid 26cff99f-ec69-43f4-b0be-dda5ce2ccd51 {{(pid=117685) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:30:14.410579 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.policy [None req-6df05e87-ea09-4b81-87cf-ec17904ad499 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c4030b5fb4381a598a54588880b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd671fcff7e4b24b5415a3a1b70ad0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117685) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:30:14.421475 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-6df05e87-ea09-4b81-87cf-ec17904ad499 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51" status: 200 len: 1231 microversion: 2.1 time: 0.110947 Aug 09 11:30:14.422138 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 589/1155] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:30:14 2022] GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51 => generated 1231 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:30:15.445032 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-cacf7f19-c129-4ca6-844f-5ff78edfa4d1 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:30:15.445799 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-cacf7f19-c129-4ca6-844f-5ff78edfa4d1 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 26cff99f-ec69-43f4-b0be-dda5ce2ccd51] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:30:15.452983 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cacf7f19-c129-4ca6-844f-5ff78edfa4d1 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:15.453490 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cacf7f19-c129-4ca6-844f-5ff78edfa4d1 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:15.453953 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cacf7f19-c129-4ca6-844f-5ff78edfa4d1 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:15.454712 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cacf7f19-c129-4ca6-844f-5ff78edfa4d1 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:15.455189 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cacf7f19-c129-4ca6-844f-5ff78edfa4d1 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:15.455633 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-cacf7f19-c129-4ca6-844f-5ff78edfa4d1 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:15.469627 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.wsgi [None req-cacf7f19-c129-4ca6-844f-5ff78edfa4d1 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] HTTP exception thrown: Instance 26cff99f-ec69-43f4-b0be-dda5ce2ccd51 could not be found. Aug 09 11:30:15.471259 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-cacf7f19-c129-4ca6-844f-5ff78edfa4d1 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Request method failure captured: Aug 09 11:30:15.471259 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: request: GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51 HTTP/1.1 Aug 09 11:30:15.471259 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept: application/json Aug 09 11:30:15.471259 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept-Encoding: identity Aug 09 11:30:15.471259 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Connection: close Aug 09 11:30:15.471259 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Length: 0 Aug 09 11:30:15.471259 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Type: application/json Aug 09 11:30:15.471259 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Host: 10.222.0.27 Aug 09 11:30:15.471259 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Openstack-System-Scope: None Aug 09 11:30:15.471259 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: User-Agent: python-urllib3/1.26.11 Aug 09 11:30:15.471259 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Auth-Token: gAAAAABi8kOSqBDhhheNHFXQC96sdrHL714LO7y9IM1Cd2MzmODs85Pa0AMSSTdl7t1_D4T9ywKgKiyJRwch62n-k-E0Cc5pubZWfo5TMk-U3KI3XaWUhA4CgUdKGTMgQkLSjcw22aBZmAyFdNDBnv73AYrYgmma8uR2-CCpbr5WgbSXeHOiK9A Aug 09 11:30:15.471259 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Id: None Aug 09 11:30:15.471259 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Name: None Aug 09 11:30:15.471259 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Identity-Status: Confirmed Aug 09 11:30:15.471259 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Is-Admin-Project: True Aug 09 11:30:15.471259 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Id: default Aug 09 11:30:15.471259 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Name: Default Aug 09 11:30:15.471259 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Id: bfd671fcff7e4b24b5415a3a1b70ad0f Aug 09 11:30:15.471259 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Name: tempest-TestVolumeBootPattern-2035807174 Aug 09 11:30:15.471259 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Role: member,reader Aug 09 11:30:15.471259 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Roles: member,reader Aug 09 11:30:15.473026 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bfd671fcff7e4b24b5415a3a1b70ad0f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bfd671fcff7e4b24b5415a3a1b70ad0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bfd671fcff7e4b24b5415a3a1b70ad0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bfd671fcff7e4b24b5415a3a1b70ad0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:30:15.473026 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant: tempest-TestVolumeBootPattern-2035807174 Aug 09 11:30:15.473026 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Id: bfd671fcff7e4b24b5415a3a1b70ad0f Aug 09 11:30:15.473026 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Name: tempest-TestVolumeBootPattern-2035807174 Aug 09 11:30:15.473026 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User: tempest-TestVolumeBootPattern-2035807174-project Aug 09 11:30:15.473026 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Id: default Aug 09 11:30:15.473026 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Name: Default Aug 09 11:30:15.473026 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Id: 5b4c4030b5fb4381a598a54588880b75 Aug 09 11:30:15.473026 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Name: tempest-TestVolumeBootPattern-2035807174-project Aug 09 11:30:15.473026 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: method: > Aug 09 11:30:15.473026 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: exception: Instance 26cff99f-ec69-43f4-b0be-dda5ce2ccd51 could not be found. Aug 09 11:30:15.473026 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: action_args: {'id': '26cff99f-ec69-43f4-b0be-dda5ce2ccd51'} Aug 09 11:30:15.474066 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:30:15.474066 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:30:15.474066 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:30:15.474066 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:30:15.474066 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:30:15.474066 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:30:15.474066 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:30:15.474066 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:30:15.474066 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:30:15.474066 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:30:15.474066 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26cff99f-ec69-43f4-b0be-dda5ce2ccd51 could not be found. Aug 09 11:30:15.474066 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:30:15.474066 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:30:15.474066 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:30:15.474066 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:30:15.474066 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:30:15.474066 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:30:15.474066 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:30:15.474066 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:30:15.474066 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:30:15.475813 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:30:15.475813 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:30:15.475813 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:30:15.475813 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:30:15.475813 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:30:15.475813 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:30:15.475813 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:30:15.475813 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26cff99f-ec69-43f4-b0be-dda5ce2ccd51 could not be found. Aug 09 11:30:15.475813 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:30:15.475813 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:30:15.475813 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:30:15.475813 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:30:15.475813 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:30:15.475813 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:30:15.475813 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:30:15.475813 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:30:15.475813 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26cff99f-ec69-43f4-b0be-dda5ce2ccd51 could not be found. Aug 09 11:30:15.475813 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:30:15.477416 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-cacf7f19-c129-4ca6-844f-5ff78edfa4d1 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Returning 404 to user: Instance 26cff99f-ec69-43f4-b0be-dda5ce2ccd51 could not be found. {{(pid=117684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:30:15.477416 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-cacf7f19-c129-4ca6-844f-5ff78edfa4d1 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51" status: 404 len: 111 microversion: 2.1 time: 0.033077 Aug 09 11:30:15.477416 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 567/1156] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:30:15 2022] GET /compute/v2.1/servers/26cff99f-ec69-43f4-b0be-dda5ce2ccd51 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:30:15.921191 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-85bae250-63c3-48a4-87d0-34e77ffb768b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:30:15.921805 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.compute.api [None req-85bae250-63c3-48a4-87d0-34e77ffb768b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 935b9a57-1104-4ad6-a0ba-3301edf35661] Fetching instance by UUID {{(pid=117685) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:30:15.929032 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-85bae250-63c3-48a4-87d0-34e77ffb768b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:15.929507 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-85bae250-63c3-48a4-87d0-34e77ffb768b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:15.929981 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-85bae250-63c3-48a4-87d0-34e77ffb768b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:15.930664 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-85bae250-63c3-48a4-87d0-34e77ffb768b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:15.931099 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-85bae250-63c3-48a4-87d0-34e77ffb768b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:15.931507 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG oslo_concurrency.lockutils [None req-85bae250-63c3-48a4-87d0-34e77ffb768b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:15.946027 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.wsgi [None req-85bae250-63c3-48a4-87d0-34e77ffb768b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] HTTP exception thrown: Instance 935b9a57-1104-4ad6-a0ba-3301edf35661 could not be found. Aug 09 11:30:15.947694 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-85bae250-63c3-48a4-87d0-34e77ffb768b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Request method failure captured: Aug 09 11:30:15.947694 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: request: DELETE /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661 HTTP/1.1 Aug 09 11:30:15.947694 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Accept: application/json Aug 09 11:30:15.947694 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Accept-Encoding: identity Aug 09 11:30:15.947694 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Connection: close Aug 09 11:30:15.947694 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Content-Length: 0 Aug 09 11:30:15.947694 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Content-Type: application/json Aug 09 11:30:15.947694 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Host: 10.222.0.27 Aug 09 11:30:15.947694 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Openstack-System-Scope: None Aug 09 11:30:15.947694 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: User-Agent: python-urllib3/1.26.11 Aug 09 11:30:15.947694 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Auth-Token: gAAAAABi8kOSqBDhhheNHFXQC96sdrHL714LO7y9IM1Cd2MzmODs85Pa0AMSSTdl7t1_D4T9ywKgKiyJRwch62n-k-E0Cc5pubZWfo5TMk-U3KI3XaWUhA4CgUdKGTMgQkLSjcw22aBZmAyFdNDBnv73AYrYgmma8uR2-CCpbr5WgbSXeHOiK9A Aug 09 11:30:15.947694 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Domain-Id: None Aug 09 11:30:15.947694 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Domain-Name: None Aug 09 11:30:15.947694 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Identity-Status: Confirmed Aug 09 11:30:15.947694 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Is-Admin-Project: True Aug 09 11:30:15.947694 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Domain-Id: default Aug 09 11:30:15.947694 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Domain-Name: Default Aug 09 11:30:15.947694 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Id: bfd671fcff7e4b24b5415a3a1b70ad0f Aug 09 11:30:15.947694 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Project-Name: tempest-TestVolumeBootPattern-2035807174 Aug 09 11:30:15.947694 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Role: member,reader Aug 09 11:30:15.947694 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Roles: member,reader Aug 09 11:30:15.949483 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bfd671fcff7e4b24b5415a3a1b70ad0f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bfd671fcff7e4b24b5415a3a1b70ad0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bfd671fcff7e4b24b5415a3a1b70ad0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bfd671fcff7e4b24b5415a3a1b70ad0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:30:15.949483 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant: tempest-TestVolumeBootPattern-2035807174 Aug 09 11:30:15.949483 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant-Id: bfd671fcff7e4b24b5415a3a1b70ad0f Aug 09 11:30:15.949483 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-Tenant-Name: tempest-TestVolumeBootPattern-2035807174 Aug 09 11:30:15.949483 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User: tempest-TestVolumeBootPattern-2035807174-project Aug 09 11:30:15.949483 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Domain-Id: default Aug 09 11:30:15.949483 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Domain-Name: Default Aug 09 11:30:15.949483 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Id: 5b4c4030b5fb4381a598a54588880b75 Aug 09 11:30:15.949483 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: X-User-Name: tempest-TestVolumeBootPattern-2035807174-project Aug 09 11:30:15.949483 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: method: > Aug 09 11:30:15.949483 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: exception: Instance 935b9a57-1104-4ad6-a0ba-3301edf35661 could not be found. Aug 09 11:30:15.949483 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: action_args: {'id': '935b9a57-1104-4ad6-a0ba-3301edf35661'} Aug 09 11:30:15.950621 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:30:15.950621 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:30:15.950621 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:30:15.950621 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:30:15.950621 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:30:15.950621 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:30:15.950621 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:30:15.950621 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:30:15.950621 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:30:15.950621 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:30:15.950621 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 935b9a57-1104-4ad6-a0ba-3301edf35661 could not be found. Aug 09 11:30:15.950621 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:30:15.950621 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:30:15.950621 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:30:15.950621 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:30:15.950621 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:30:15.950621 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:30:15.950621 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:30:15.950621 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:30:15.950621 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:30:15.952186 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:30:15.952186 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 11:30:15.952186 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 11:30:15.952186 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 11:30:15.952186 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 11:30:15.952186 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:30:15.952186 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:30:15.952186 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:30:15.952186 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:30:15.952186 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 935b9a57-1104-4ad6-a0ba-3301edf35661 could not be found. Aug 09 11:30:15.952186 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:30:15.952186 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:30:15.952186 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:30:15.952186 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:30:15.952186 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:30:15.952186 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:30:15.952186 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:30:15.952186 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:30:15.952186 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 935b9a57-1104-4ad6-a0ba-3301edf35661 could not be found. Aug 09 11:30:15.952186 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR nova.api.openstack.wsgi Aug 09 11:30:15.953964 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-85bae250-63c3-48a4-87d0-34e77ffb768b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Returning 404 to user: Instance 935b9a57-1104-4ad6-a0ba-3301edf35661 could not be found. {{(pid=117685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:30:15.953964 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-85bae250-63c3-48a4-87d0-34e77ffb768b tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "DELETE /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661" status: 404 len: 111 microversion: 2.1 time: 0.032218 Aug 09 11:30:15.953964 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 590/1157] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 9 11:30:15 2022] DELETE /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:30:15.958263 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-642a12de-bd2b-43e2-852c-855de48ddea7 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '>' {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:30:15.958866 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.compute.api [None req-642a12de-bd2b-43e2-852c-855de48ddea7 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [instance: 935b9a57-1104-4ad6-a0ba-3301edf35661] Fetching instance by UUID {{(pid=117684) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:30:15.965083 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-642a12de-bd2b-43e2-852c-855de48ddea7 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:15.965553 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-642a12de-bd2b-43e2-852c-855de48ddea7 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:15.965968 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-642a12de-bd2b-43e2-852c-855de48ddea7 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:15.966653 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-642a12de-bd2b-43e2-852c-855de48ddea7 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Acquiring lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:15.967093 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-642a12de-bd2b-43e2-852c-855de48ddea7 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:15.967535 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG oslo_concurrency.lockutils [None req-642a12de-bd2b-43e2-852c-855de48ddea7 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Lock "ad0e4d4c-ebcc-4363-b137-c73e7b855b1b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:15.981014 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.wsgi [None req-642a12de-bd2b-43e2-852c-855de48ddea7 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] HTTP exception thrown: Instance 935b9a57-1104-4ad6-a0ba-3301edf35661 could not be found. Aug 09 11:30:15.982530 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-642a12de-bd2b-43e2-852c-855de48ddea7 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Request method failure captured: Aug 09 11:30:15.982530 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: request: GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661 HTTP/1.1 Aug 09 11:30:15.982530 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept: application/json Aug 09 11:30:15.982530 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Accept-Encoding: identity Aug 09 11:30:15.982530 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Connection: close Aug 09 11:30:15.982530 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Length: 0 Aug 09 11:30:15.982530 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Content-Type: application/json Aug 09 11:30:15.982530 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Host: 10.222.0.27 Aug 09 11:30:15.982530 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Openstack-System-Scope: None Aug 09 11:30:15.982530 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: User-Agent: python-urllib3/1.26.11 Aug 09 11:30:15.982530 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Auth-Token: gAAAAABi8kOSqBDhhheNHFXQC96sdrHL714LO7y9IM1Cd2MzmODs85Pa0AMSSTdl7t1_D4T9ywKgKiyJRwch62n-k-E0Cc5pubZWfo5TMk-U3KI3XaWUhA4CgUdKGTMgQkLSjcw22aBZmAyFdNDBnv73AYrYgmma8uR2-CCpbr5WgbSXeHOiK9A Aug 09 11:30:15.982530 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Id: None Aug 09 11:30:15.982530 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Domain-Name: None Aug 09 11:30:15.982530 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Identity-Status: Confirmed Aug 09 11:30:15.982530 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Is-Admin-Project: True Aug 09 11:30:15.982530 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Id: default Aug 09 11:30:15.982530 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Domain-Name: Default Aug 09 11:30:15.982530 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Id: bfd671fcff7e4b24b5415a3a1b70ad0f Aug 09 11:30:15.982530 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Project-Name: tempest-TestVolumeBootPattern-2035807174 Aug 09 11:30:15.982530 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Role: member,reader Aug 09 11:30:15.982530 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Roles: member,reader Aug 09 11:30:15.984219 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bfd671fcff7e4b24b5415a3a1b70ad0f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bfd671fcff7e4b24b5415a3a1b70ad0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bfd671fcff7e4b24b5415a3a1b70ad0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bfd671fcff7e4b24b5415a3a1b70ad0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Aug 09 11:30:15.984219 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant: tempest-TestVolumeBootPattern-2035807174 Aug 09 11:30:15.984219 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Id: bfd671fcff7e4b24b5415a3a1b70ad0f Aug 09 11:30:15.984219 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-Tenant-Name: tempest-TestVolumeBootPattern-2035807174 Aug 09 11:30:15.984219 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User: tempest-TestVolumeBootPattern-2035807174-project Aug 09 11:30:15.984219 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Id: default Aug 09 11:30:15.984219 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Domain-Name: Default Aug 09 11:30:15.984219 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Id: 5b4c4030b5fb4381a598a54588880b75 Aug 09 11:30:15.984219 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: X-User-Name: tempest-TestVolumeBootPattern-2035807174-project Aug 09 11:30:15.984219 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: method: > Aug 09 11:30:15.984219 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: exception: Instance 935b9a57-1104-4ad6-a0ba-3301edf35661 could not be found. Aug 09 11:30:15.984219 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: action_args: {'id': '935b9a57-1104-4ad6-a0ba-3301edf35661'} Aug 09 11:30:15.985105 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: {{(pid=117684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:30:15.985105 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:30:15.985105 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:30:15.985105 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:30:15.985105 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:30:15.985105 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:30:15.985105 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:30:15.985105 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:30:15.985105 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:30:15.985105 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:30:15.985105 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 935b9a57-1104-4ad6-a0ba-3301edf35661 could not be found. Aug 09 11:30:15.985105 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:30:15.985105 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:30:15.985105 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:30:15.985105 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:30:15.985105 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:30:15.985105 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:30:15.985105 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:30:15.985105 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:30:15.985105 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:30:15.986394 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:30:15.986394 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:30:15.986394 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:30:15.986394 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:30:15.986394 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:30:15.986394 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:30:15.986394 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:30:15.986394 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 935b9a57-1104-4ad6-a0ba-3301edf35661 could not be found. Aug 09 11:30:15.986394 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:30:15.986394 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:30:15.986394 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:30:15.986394 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:30:15.986394 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:30:15.986394 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:30:15.986394 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:30:15.986394 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:30:15.986394 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 935b9a57-1104-4ad6-a0ba-3301edf35661 could not be found. Aug 09 11:30:15.986394 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: ERROR nova.api.openstack.wsgi Aug 09 11:30:15.987565 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: DEBUG nova.api.openstack.wsgi [None req-642a12de-bd2b-43e2-852c-855de48ddea7 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Returning 404 to user: Instance 935b9a57-1104-4ad6-a0ba-3301edf35661 could not be found. {{(pid=117684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:30:15.987565 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO nova.api.openstack.requestlog [None req-642a12de-bd2b-43e2-852c-855de48ddea7 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661" status: 404 len: 111 microversion: 2.1 time: 0.029873 Aug 09 11:30:15.987565 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: [pid: 117684|app: 0|req: 568/1158] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 9 11:30:15 2022] GET /compute/v2.1/servers/935b9a57-1104-4ad6-a0ba-3301edf35661 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:30:17.302241 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: DEBUG nova.api.openstack.wsgi [None req-c9d70730-c2d3-4494-9574-36b669c238b6 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] Calling method '.version_select at 0x7f2822161820>' {{(pid=117685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:30:17.307622 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c9d70730-c2d3-4494-9574-36b669c238b6 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [aec081eb-991d-4b9a-9ccd-31c29d715e02] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 09 11:30:18.315196 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO oslo.messaging._drivers.impl_rabbit [None req-c9d70730-c2d3-4494-9574-36b669c238b6 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] [aec081eb-991d-4b9a-9ccd-31c29d715e02] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 41574. Aug 09 11:30:18.338159 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO nova.api.openstack.requestlog [None req-c9d70730-c2d3-4494-9574-36b669c238b6 tempest-TestVolumeBootPattern-2035807174 tempest-TestVolumeBootPattern-2035807174-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1024053701" status: 202 len: 0 microversion: 2.1 time: 1.039678 Aug 09 11:30:18.339035 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: [pid: 117685|app: 0|req: 591/1159] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Aug 9 11:30:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1024053701 => generated 0 bytes in 1041 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:31:23.875256 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 11:31:23.876443 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Tue Aug 9 11:31:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 11:31:24.622989 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 11:31:24.623745 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Tue Aug 9 11:31:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 11:33:03.249720 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 11:33:03.250698 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Tue Aug 9 11:33:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 11:33:18.985683 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 11:33:18.986508 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Tue Aug 9 11:33:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 11:33:20.707267 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 11:33:20.708103 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Tue Aug 9 11:33:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 11:34:43.886932 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 11:34:43.888201 dv-cinder-852514-2-iscsi devstack@n-api.service[117684]: Tue Aug 9 11:34:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 11:34:44.636807 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 11:34:44.637764 dv-cinder-852514-2-iscsi devstack@n-api.service[117685]: Tue Aug 9 11:34:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!